-- Logs begin at Thu 2022-10-27 00:44:19 UTC, end at Thu 2022-10-27 01:43:09 UTC. -- Oct 27 01:10:06.764241 dv-cinder-815582-19-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 27 01:10:06.771860 dv-cinder-815582-19-smb devstack@keystone.service[81607]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 01:10:06 2022] *** Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: nodename: dv-cinder-815582-19-smb Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: machine: x86_64 Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: clock source: unix Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: pcre jit disabled Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: detected number of CPU cores: 4 Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: current working directory: / Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: detected binary path: /usr/bin/uwsgi-core Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: your processes number limit is 47680 Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: your memory page size is 4096 bytes Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: detected max file descriptor number: 2048 Oct 27 01:10:06.773882 dv-cinder-815582-19-smb devstack@keystone.service[81607]: lock engine: pthread robust mutexes Oct 27 01:10:06.774770 dv-cinder-815582-19-smb devstack@keystone.service[81607]: thunder lock: enabled Oct 27 01:10:06.774770 dv-cinder-815582-19-smb devstack@keystone.service[81607]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 27 01:10:06.774770 dv-cinder-815582-19-smb devstack@keystone.service[81607]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 01:10:06.813812 dv-cinder-815582-19-smb devstack@keystone.service[81607]: Python main interpreter initialized at 0x565552e5e9c0 Oct 27 01:10:06.813812 dv-cinder-815582-19-smb devstack@keystone.service[81607]: python threads support enabled Oct 27 01:10:06.813812 dv-cinder-815582-19-smb devstack@keystone.service[81607]: your server socket listen backlog is limited to 100 connections Oct 27 01:10:06.813812 dv-cinder-815582-19-smb devstack@keystone.service[81607]: your mercy for graceful operations on workers is 90 seconds Oct 27 01:10:06.814193 dv-cinder-815582-19-smb devstack@keystone.service[81607]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 01:10:06.814281 dv-cinder-815582-19-smb devstack@keystone.service[81607]: *** Operational MODE: preforking *** Oct 27 01:10:06.814535 dv-cinder-815582-19-smb devstack@keystone.service[81607]: *** uWSGI is running in multiple interpreter mode *** Oct 27 01:10:06.814535 dv-cinder-815582-19-smb devstack@keystone.service[81607]: spawned uWSGI master process (pid: 81607) Oct 27 01:10:06.814772 dv-cinder-815582-19-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 27 01:10:06.815292 dv-cinder-815582-19-smb devstack@keystone.service[81607]: spawned uWSGI worker 1 (pid: 81615, cores: 1) Oct 27 01:10:06.815620 dv-cinder-815582-19-smb devstack@keystone.service[81607]: spawned uWSGI worker 2 (pid: 81616, cores: 1) Oct 27 01:10:06.815766 dv-cinder-815582-19-smb devstack@keystone.service[81607]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 01:10:10.999272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:10:10.999272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: from cryptography.utils import int_from_bytes Oct 27 01:10:11.000099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:10:11.000099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: from cryptography.utils import int_from_bytes Oct 27 01:10:11.000513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:10:11.000513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: from cryptography.utils import int_from_bytes Oct 27 01:10:11.000624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:10:11.000624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: from cryptography.utils import int_from_bytes Oct 27 01:10:11.048772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:10:11.048963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:10:11.049050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:10:11.049125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] command line args: [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:10:11.049267 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:10:11.049397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:10:11.049493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] command line args: [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:10:11.049567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ================================================================================ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:10:11.049731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:10:11.049826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] admin_token = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.049892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ================================================================================ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:10:11.049970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config_dir = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.050084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] admin_token = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.050174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.050377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config_source = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.050496 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] config_dir = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.050581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] debug = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.050652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.050652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] config_source = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.050813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] debug = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051934 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.051999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_config_append = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052258 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_config_append = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_dir = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_dir = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052830 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_file = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.052956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053674 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053743 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053869 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.053931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.054093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.054172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.054292 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.054404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.054520 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.054645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.054816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.054895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.055008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.055082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.055195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.055270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.055447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.055568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.055646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.055718 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.055915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.056047 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.056148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.056425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.056557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] publish_errors = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.056692 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.056782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.056857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] publish_errors = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.057031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.057163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.057252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.057328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.057501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.057622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.057757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.057881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.057994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.058110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] standard_threads = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.058221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] standard_threads = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.058331 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.058451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.058564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.058564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.058816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.058938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_journal = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.059050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.059228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_json = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.059344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_journal = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.059461 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_stderr = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.059578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_json = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.059730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_syslog = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.059883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_stderr = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.059883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_syslog = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.060111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.060222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:10:11.060332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.060442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.060559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.060678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.060796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.060908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.061019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.061127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.061238 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.061359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.061471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.061586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.061697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.061807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.061916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.062038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.062157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.062268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.062377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.062486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.062597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.062739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.062854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.062965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.063076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.063186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.063296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.063419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.063532 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.063652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.063747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.063852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.063965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.064084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.064197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.064307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.064418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.064527 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.064721 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.064841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.064952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.065068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.065180 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.065289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.065407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.065525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.065642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.065752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.065861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.065971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.066090 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.066209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.066327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.066437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.066553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.066670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.066811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.066924 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.067034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.067150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.067358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.067477 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.067597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.067715 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.067826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.067943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.068056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.068166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.068288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.068401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.068511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.068634 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.068746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.068855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.068976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.069088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.069198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.069358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.069473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.069586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.069703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.069814 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.069928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.070037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.070146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.070261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.070450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.070564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.070673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.070839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.070952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.071062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.071183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.071294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.071404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.071514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.071623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.071732 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.071850 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.071963 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.072072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.072181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.072296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.072413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.072536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.072653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.072764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.072873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.072988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.073099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.073203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.073299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.073393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.073521 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.073625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.073729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.073825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.073924 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.074018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.074117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.074229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.074350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.074463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.074575 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.074696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.074839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.074962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.075083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.075196 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.075310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.075422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.075532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.075644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.075763 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.075875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.075993 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.076106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.076222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.076335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.076444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.076554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.076685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.076800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.076901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.077011 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.077131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.077233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.077355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.077469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.077579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.077697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.077809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.077920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.078039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.078152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.078263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.078365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.078473 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.078591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.078711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.078847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.078968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.079082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.079192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.079303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.079428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.079542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.079652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.079763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.079878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.079989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.080108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.080220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.080333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.080444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.080554 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.080671 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.080791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.080905 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.081015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.081126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.081235 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.081346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.081534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.081648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.081759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.081870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.081981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.082102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.082222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.082344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.082457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.082569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.082679 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.082857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.082977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.083099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.083211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.083329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.083441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.083554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.083664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.083784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.083896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.084008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.084119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.084229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.084340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.084462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.084583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.084696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.084807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.084917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.085057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.085181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.external = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.085295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.external = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.085415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.085537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.085651 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.085763 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.085883 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.085996 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.086116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.password = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.086231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.password = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.086343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.token = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.086454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.token = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.086565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.086677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.086815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.086930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.087042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.087153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.087265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.087376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.087497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.087611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.087724 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.087835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.087947 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.088058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.088178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.088292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.088404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.088515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.088627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.088738 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.088858 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.088971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.089083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.089194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.089306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.089417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.089536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.089649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.089761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.089875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.089987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.090104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.090225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.090340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.090452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.090563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.090674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.090814 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.090939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.091053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.091176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.091289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.091402 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.091513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.091634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.091747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.091859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.091970 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.092081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.092192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.092312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.092418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.092522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.092632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.092743 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.092862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.093015 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.093136 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.093248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.093359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.093477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.093599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.093713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.093824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.093935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.094045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.094157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.094282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.094396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.094507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.094625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.094767 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.094881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.095079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.095196 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.095315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.095428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.095539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.095652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.095772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.095886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.095997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.096108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.096219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.096331 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.096450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.096564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.096676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.096787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.096898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.097009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.097129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.097244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.097355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.097467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.097578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.097691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.097811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.097925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.098044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.098158 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.098269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.098381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.098536 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.098651 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.098780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.098895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.099007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.099118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.099242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.099357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.099470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.099582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.099693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.099806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.099936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.100051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.100171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.100283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.100390 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.100503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.100623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.100737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.100855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.100968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.101080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.101200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.101313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.101425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.101536 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.101648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.101759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.101881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.101994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.102112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.102225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.102337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.102449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.102569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.102682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.102851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.102966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.103078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.103190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.103314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.103429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.103542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.103652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.103652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.103861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.103982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.104096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.104208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.104320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.104437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.104550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.104669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.104783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.104895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.105007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.105118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.105229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.105349 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.105463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.105574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.105686 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.105805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.105918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.106039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.106153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.106265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.106382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.106495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.106607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.106745 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.106860 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.106972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.107075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.107187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.107298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.107422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.107537 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.107649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.107760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.107873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.107984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.108104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.108219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.108331 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.108443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.108554 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.108665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.108786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.108908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.109021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.109133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.109246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.109358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.109478 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.109591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.109704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.109815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.109929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.110041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.110162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.110276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.110388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.110499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.110610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.110738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.110866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.110980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.111092 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.111203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.111316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.111427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.111547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.111661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.111772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.111884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.111995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.112107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.112228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.112341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.112453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.112570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.112686 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.112797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.112918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.113032 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.113144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.113255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.113368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.113480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.113599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.113712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.113824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.113934 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.114046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.114157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.114277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.114397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.114511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.114622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.114751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.114864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.114988 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.115102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.115214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.115325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.115435 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.115547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.115667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.115780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.115891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.116002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.116113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.116232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.116345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.116456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.116568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.116680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.116797 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.116988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.117104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.117215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.117326 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] role.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.117437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.117549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] role.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.117669 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.117783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.117894 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.118006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.118117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.118228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.118348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.118463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.118565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.118677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.118870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.118984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.119108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.119224 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.119337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.119447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.119558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.119669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.119793 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.119913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.120024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.120134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.120245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.120356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.120478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.120592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.120707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.120820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.120930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.121042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.121164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.121279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.121390 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.121501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.121612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.121725 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.121845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.121959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.122070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.122182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.122293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.122414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.122528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.122640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.122764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.122879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.122990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.123114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.123228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.123340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.123450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.123561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.123672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.123792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.123906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.124017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.124129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.124240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.124350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.124470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.124583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.124695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.124805 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.124916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.125028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.125152 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.125265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.125376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.125487 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.125597 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.125708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.125827 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.125940 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.126052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.126162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.126273 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.126384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.126504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.126616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.126740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.126854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.126965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.127077 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.127201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.127315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.127427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.127538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.127649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.127760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.127880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.127995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.128108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.128219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.128330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.128440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.128560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.128673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.128785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.128904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.129030 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.129157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.129271 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.129390 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.129502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.129622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.129804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.129922 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.130036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.130148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.130261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.130383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.130498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.130610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.130851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.130970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.131083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.131208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.131324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.131437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.131549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.131660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.131772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.131893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.132008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.132126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.132239 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.132352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.132464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.132584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.132698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.132810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.132923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.133034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.133146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.133266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.133381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.133493 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.133605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.133717 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.133828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.133949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:10:11.134063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:10:11.134183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:10:11.160687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.160844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.161074 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.161158 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.161222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.161343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.169442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.169623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.197345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.197574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.198426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.198623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.249494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.249760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.297538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.297765 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.298195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.298426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.454546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.454801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.455004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.455097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.455225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.455333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.455441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.455528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.455653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.455739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.455866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.456078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.478369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.478507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.478647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.478752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.478945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.479037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.479189 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.479327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.479466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.479558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.479669 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.479759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.479865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.479944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.490867 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.491085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.503572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.503845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.503968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.504129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.504214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.504278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.504346 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.504465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.504537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.504704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.504829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.504966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.505047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.505111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:10:11.522103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.522317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 01:10:11.522638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.522782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.522920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 01:10:11.523001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 01:10:11.523091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.523286 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.523411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.523538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 01:10:11.523746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.523881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.524017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.524098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.524216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.524499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.533425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.533697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.533968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.534091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.534227 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.534313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.534579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.534888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.541217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.542087 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.544118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.544406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.544695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.544974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.545099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.545228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.545312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.545504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.545629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.545768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.545890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.546021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.546229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.546354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.546490 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.546693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.546850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.547000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.547084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.547240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.547533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.547802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.569376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.570318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.570851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.571134 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.571806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.572093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.576746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.577037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.577321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.577445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.577691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.577973 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.583681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.583966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.584483 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.584772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.588921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.589215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.589505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.589628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.589766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.589914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.590053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.590190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.590302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.590508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.590633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.590808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.590893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.591050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.591334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.591607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.606346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.606627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.607169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.607452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.610486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.611315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.613701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.614001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.614553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.614930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.618251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.619110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.621395 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.622347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.624620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.624919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.625200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.625491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.625615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.625754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.625835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.626051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.626179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.626403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.626698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.627011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.642094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.642381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.642650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.642931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.643054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.643206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.643488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.643759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.649816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.650582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.651356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.652138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.652888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.653228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.653676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.653965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.655918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.656179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.656590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.656714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.656853 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.656933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.657145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.657271 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.657533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.657899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.668242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.668531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.668907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.669030 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.669169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.669264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.669464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.669588 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.669743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.669910 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.669999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.670111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.670425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.670711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.685715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.686380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.688637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.689287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.691593 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.692199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.693074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.693633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.694665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.694981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.695154 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.695240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.695406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.695809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.701539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.702068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.703018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.703594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.706065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.706294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.706418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.706555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.706819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.706929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.707121 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.707402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.714735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.715028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.715153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.715297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.715502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.715716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.722532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.722840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.722983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:10:11.723121 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.723282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.723407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.723543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.723657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.723806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.723968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.724095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.724231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.724343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.724485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.724653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.724755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.724930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.725070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.725181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.725270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.725476 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.725603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.725734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.725816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.726014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.726141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.726250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.726539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:10:11.759247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565552e5e9c0 pid: 81615 (default app) Oct 27 01:10:11.759541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565552e5e9c0 pid: 81616 (default app) Oct 27 01:10:11.762941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3975-7f57-4af8-bf65-5189c69df802 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:11.763227 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3975-7f57-4af8-bf65-5189c69df802 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:11.763501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3975-7f57-4af8-bf65-5189c69df802 None None] PATH_INFO: `/v3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:11.767707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Thu Oct 27 01:10:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:18.517662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59cc45-e9c8-45ba-8e5c-8227f9b05e12 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:18.518208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59cc45-e9c8-45ba-8e5c-8227f9b05e12 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:18.518208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59cc45-e9c8-45ba-8e5c-8227f9b05e12 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:18.522605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:10:18.529161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:18.530143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:18.530143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:18.614126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: INFO dbcounter [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] Registered counter for database keystone Oct 27 01:10:18.634842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:10:18.646666 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writer thread running {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:10:18.833113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG passlib.handlers.bcrypt [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81615) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 01:10:18.833380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG passlib.handlers.bcrypt [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81615) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 01:10:18.893007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:18.894747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:19.036748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 01:10:19.524600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59cc45-e9c8-45ba-8e5c-8227f9b05e12 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:19.599283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: INFO dbcounter [None req-db59cc45-e9c8-45ba-8e5c-8227f9b05e12 None None] Registered counter for database keystone Oct 27 01:10:19.624085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG oslo_db.sqlalchemy.engines [None req-db59cc45-e9c8-45ba-8e5c-8227f9b05e12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:10:19.632303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writer thread running {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:10:19.750877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59cc45-e9c8-45ba-8e5c-8227f9b05e12 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:19.756374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e5cb5-37e8-4262-aa41-e12ded2fffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:19.756997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e5cb5-37e8-4262-aa41-e12ded2fffa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:19.757279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e5cb5-37e8-4262-aa41-e12ded2fffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:19.757579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e5cb5-37e8-4262-aa41-e12ded2fffa1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:19.767463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e5cb5-37e8-4262-aa41-e12ded2fffa1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:19.819073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f59e5cb5-37e8-4262-aa41-e12ded2fffa1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 01:10:19.819345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e5cb5-37e8-4262-aa41-e12ded2fffa1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:19.829747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Oct 27 01:10:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:10:19.838034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:19.856712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc7b89-76f5-4cba-90d2-5e553ac6d980 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:19.862054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10115a11-0f66-45b5-a064-cf5de9cb9a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:19.863280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10115a11-0f66-45b5-a064-cf5de9cb9a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:19.863567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10115a11-0f66-45b5-a064-cf5de9cb9a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:19.863826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10115a11-0f66-45b5-a064-cf5de9cb9a70 admin admin] PATH_INFO: `/v3/projects/ab267813de0e4d19a617dbecdaeb9ab0` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:19.867774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10115a11-0f66-45b5-a064-cf5de9cb9a70 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab267813de0e4d19a617dbecdaeb9ab0)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:19.919017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING keystone.common.rbac_enforcer.enforcer [None req-10115a11-0f66-45b5-a064-cf5de9cb9a70 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 01:10:19.919339 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10115a11-0f66-45b5-a064-cf5de9cb9a70 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:19.924100 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Oct 27 01:10:19 2022] GET /identity/v3/projects/ab267813de0e4d19a617dbecdaeb9ab0 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:22.035059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559543-2c4e-493c-81ad-8acf6dbd28eb None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:22.035957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559543-2c4e-493c-81ad-8acf6dbd28eb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:22.035957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559543-2c4e-493c-81ad-8acf6dbd28eb None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:22.042753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:22.051878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151d4cd-69af-455f-a58d-4d012f9cd252 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:22.052580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151d4cd-69af-455f-a58d-4d012f9cd252 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:22.052724 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151d4cd-69af-455f-a58d-4d012f9cd252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:22.075997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7151d4cd-69af-455f-a58d-4d012f9cd252 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:22.077519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7151d4cd-69af-455f-a58d-4d012f9cd252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:22.087716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 01:10:22.348784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559543-2c4e-493c-81ad-8acf6dbd28eb None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:22.363532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559543-2c4e-493c-81ad-8acf6dbd28eb None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:22.368942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f38a-7e14-4e6e-8cd0-09214ac48833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:22.369543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f38a-7e14-4e6e-8cd0-09214ac48833 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:22.369817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f38a-7e14-4e6e-8cd0-09214ac48833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:22.370092 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f38a-7e14-4e6e-8cd0-09214ac48833 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:22.378530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995f38a-7e14-4e6e-8cd0-09214ac48833 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:22.380332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995f38a-7e14-4e6e-8cd0-09214ac48833 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:22.389420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Oct 27 01:10:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:10:22.395355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151d4cd-69af-455f-a58d-4d012f9cd252 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:22.410177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151d4cd-69af-455f-a58d-4d012f9cd252 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:22.417012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a884bd-6573-4cfc-b9f3-d79fc1cdd65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:22.417645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a884bd-6573-4cfc-b9f3-d79fc1cdd65a admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:22.417923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a884bd-6573-4cfc-b9f3-d79fc1cdd65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:22.418192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a884bd-6573-4cfc-b9f3-d79fc1cdd65a admin admin] PATH_INFO: `/v3/users/b819844d641b4956ae9399e9c171524d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:22.419551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a884bd-6573-4cfc-b9f3-d79fc1cdd65a admin admin] RBAC: Authorizing `identity:get_user(user_id=b819844d641b4956ae9399e9c171524d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:22.421351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a884bd-6573-4cfc-b9f3-d79fc1cdd65a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:22.422864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Oct 27 01:10:22 2022] GET /identity/v3/users/b819844d641b4956ae9399e9c171524d => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:24.599178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b6dbb-0d11-456b-ae43-7c0bd594a8b1 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:24.599748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b6dbb-0d11-456b-ae43-7c0bd594a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:24.599748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b6dbb-0d11-456b-ae43-7c0bd594a8b1 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:24.601063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:24.606528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5c9c4-58b8-4f1b-b25c-5e3cb2f33940 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:24.606988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5c9c4-58b8-4f1b-b25c-5e3cb2f33940 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:24.607079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5c9c4-58b8-4f1b-b25c-5e3cb2f33940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:24.615100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f2b07-e31b-4956-976f-62cbe29ee3cd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:24.615431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f2b07-e31b-4956-976f-62cbe29ee3cd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:24.615837 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f2b07-e31b-4956-976f-62cbe29ee3cd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:24.617920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:24.623801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a065b-bcf3-4c1d-8943-869d191e1327 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:24.624163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a065b-bcf3-4c1d-8943-869d191e1327 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:24.624425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a065b-bcf3-4c1d-8943-869d191e1327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:24.628058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ffb5c9c4-58b8-4f1b-b25c-5e3cb2f33940 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:24.629220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ffb5c9c4-58b8-4f1b-b25c-5e3cb2f33940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:24.666461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG passlib.handlers.bcrypt [None req-cd4a065b-bcf3-4c1d-8943-869d191e1327 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81616) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 01:10:24.666890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG passlib.handlers.bcrypt [None req-cd4a065b-bcf3-4c1d-8943-869d191e1327 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81616) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 01:10:24.714594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:24.715055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cd4a065b-bcf3-4c1d-8943-869d191e1327 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:24.716649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cd4a065b-bcf3-4c1d-8943-869d191e1327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:24.816703 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:24.977687 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5c9c4-58b8-4f1b-b25c-5e3cb2f33940 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:25.002784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:25.077321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a065b-bcf3-4c1d-8943-869d191e1327 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:25.087149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5c9c4-58b8-4f1b-b25c-5e3cb2f33940 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:25.122536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc34bcb-fdf5-4383-b5c6-6fdc86925e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:25.123236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc34bcb-fdf5-4383-b5c6-6fdc86925e5f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:25.123515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc34bcb-fdf5-4383-b5c6-6fdc86925e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:25.123787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc34bcb-fdf5-4383-b5c6-6fdc86925e5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:25.135439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc34bcb-fdf5-4383-b5c6-6fdc86925e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-fdc34bcb-fdf5-4383-b5c6-6fdc86925e5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:25.144729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:25.145633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:25.146645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:25.151756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc34bcb-fdf5-4383-b5c6-6fdc86925e5f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:25.176094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a065b-bcf3-4c1d-8943-869d191e1327 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:25.178347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:25.212697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:25.213596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:25.213873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:25.214149 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:25.215157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:25.216598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:25.227853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.sql.core [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 01:10:25.227853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 01:10:25.227853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [parameters: {'id': 'ea08077fdef14bee94448d5966dbad60', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 01:10:25.227853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81616) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:10:25.233003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:10:25.246653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application result.read() Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 01:10:25.247547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application yield resource Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise self.value Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application session.commit() Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 01:10:25.248441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.session.flush() Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application compat.raise_( Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 01:10:25.249283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 01:10:25.250168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application result.read() Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:10:25.252157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [parameters: {'id': 'ea08077fdef14bee94448d5966dbad60', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 01:10:25.253870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:25.255467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:25.257006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 8/15] 10.222.0.23 () {60 vars in 1137 bytes} [Thu Oct 27 01:10:25 2022] POST /identity/v3/domains => generated 190 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:10:25.258038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc34bcb-fdf5-4383-b5c6-6fdc86925e5f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:25.258129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:25.287361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644c95f-f3c8-4897-9851-9dc705ef7a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:25.288236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644c95f-f3c8-4897-9851-9dc705ef7a48 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:25.288634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644c95f-f3c8-4897-9851-9dc705ef7a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:25.288955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644c95f-f3c8-4897-9851-9dc705ef7a48 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:25.289611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644c95f-f3c8-4897-9851-9dc705ef7a48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:25.289917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644c95f-f3c8-4897-9851-9dc705ef7a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:25.291335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644c95f-f3c8-4897-9851-9dc705ef7a48 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:25.303154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:10:25.308834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644c95f-f3c8-4897-9851-9dc705ef7a48 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:25.355137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb6692-04e2-4a12-a78d-734fe6613475 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:25.387702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba629760-6119-4e85-85d7-c061434579e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:25.388567 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba629760-6119-4e85-85d7-c061434579e0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:25.388845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba629760-6119-4e85-85d7-c061434579e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:25.389131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba629760-6119-4e85-85d7-c061434579e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:25.406837 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba629760-6119-4e85-85d7-c061434579e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:25.408305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba629760-6119-4e85-85d7-c061434579e0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:25.409849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644c95f-f3c8-4897-9851-9dc705ef7a48 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ba629760-6119-4e85-85d7-c061434579e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:10:25.424227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:25.425172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:10:25.425978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:10:25.425978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:10:25.425978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:25.425978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:25.431243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba629760-6119-4e85-85d7-c061434579e0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:25.443737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ac2c-7182-448c-ac70-c9cd087a46f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:25.444383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ac2c-7182-448c-ac70-c9cd087a46f8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:25.444665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ac2c-7182-448c-ac70-c9cd087a46f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:25.444997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ac2c-7182-448c-ac70-c9cd087a46f8 None admin] PATH_INFO: `/v3/users/b819844d641b4956ae9399e9c171524d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:25.446217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ac2c-7182-448c-ac70-c9cd087a46f8 None admin] RBAC: Authorizing `identity:get_user(user_id=b819844d641b4956ae9399e9c171524d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:25.447695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ac2c-7182-448c-ac70-c9cd087a46f8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:25.449269 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:25 2022] GET /identity/v3/users/b819844d641b4956ae9399e9c171524d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:25.452562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:25.454650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ac2c-7182-448c-ac70-c9cd087a46f8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:25.469674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:25.533041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba629760-6119-4e85-85d7-c061434579e0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:25.555133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ac2c-7182-448c-ac70-c9cd087a46f8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:25.572028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e70ed-be3a-44bf-ba42-fca9491bcf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:25.572643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e70ed-be3a-44bf-ba42-fca9491bcf94 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:25.572919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e70ed-be3a-44bf-ba42-fca9491bcf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:25.573183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e70ed-be3a-44bf-ba42-fca9491bcf94 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:25.573826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e70ed-be3a-44bf-ba42-fca9491bcf94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:25.574123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e70ed-be3a-44bf-ba42-fca9491bcf94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:25.575555 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e70ed-be3a-44bf-ba42-fca9491bcf94 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:25.589922 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bbc3e-278f-4741-99e5-50532839f3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:25.590562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bbc3e-278f-4741-99e5-50532839f3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:25.590893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bbc3e-278f-4741-99e5-50532839f3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:25.591162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bbc3e-278f-4741-99e5-50532839f3b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:25.592294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bbc3e-278f-4741-99e5-50532839f3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:25.592549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:25.593890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bbc3e-278f-4741-99e5-50532839f3b4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:25.595607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:10:25.601675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e70ed-be3a-44bf-ba42-fca9491bcf94 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:25.693753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:25.716930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e70ed-be3a-44bf-ba42-fca9491bcf94 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:25.754168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bebe0c-8e55-4e2e-86ac-322d989cf40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:25.754900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bebe0c-8e55-4e2e-86ac-322d989cf40a None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:25.755179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bebe0c-8e55-4e2e-86ac-322d989cf40a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:25.755454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bebe0c-8e55-4e2e-86ac-322d989cf40a None admin] PATH_INFO: `/v3/domains/default/users/b819844d641b4956ae9399e9c171524d/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:25.757709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bebe0c-8e55-4e2e-86ac-322d989cf40a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b819844d641b4956ae9399e9c171524d, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:25.759217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bebe0c-8e55-4e2e-86ac-322d989cf40a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:25.874546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1361 bytes} [Thu Oct 27 01:10:25 2022] PUT /identity/v3/domains/default/users/b819844d641b4956ae9399e9c171524d/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:10:28.325136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ed6d-1ef4-444f-a75c-7a8766aa4ab8 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:28.325655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ed6d-1ef4-444f-a75c-7a8766aa4ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:28.325655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ed6d-1ef4-444f-a75c-7a8766aa4ab8 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:28.327303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:28.333363 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2112a-69a7-4a4f-8c33-6f269db1f285 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:28.334172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2112a-69a7-4a4f-8c33-6f269db1f285 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:28.334637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2112a-69a7-4a4f-8c33-6f269db1f285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:28.361717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-04e2112a-69a7-4a4f-8c33-6f269db1f285 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:28.363618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-04e2112a-69a7-4a4f-8c33-6f269db1f285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:28.448374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:28.682344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b9fd-d3f5-409b-8299-2069bec7197a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:28.683047 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b9fd-d3f5-409b-8299-2069bec7197a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:28.683518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b9fd-d3f5-409b-8299-2069bec7197a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:28.685110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:28.690666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e62d17-7662-4f72-b6f5-65d70917c924 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:28.691301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e62d17-7662-4f72-b6f5-65d70917c924 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:28.691784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e62d17-7662-4f72-b6f5-65d70917c924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:28.716430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f2e62d17-7662-4f72-b6f5-65d70917c924 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:28.718002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f2e62d17-7662-4f72-b6f5-65d70917c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:28.794317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:28.799507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:28.819089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89ec34-5ea0-4c1a-acac-ad64d45eac2a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:28.819411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89ec34-5ea0-4c1a-acac-ad64d45eac2a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:28.819642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89ec34-5ea0-4c1a-acac-ad64d45eac2a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:28.821191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 13/26] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:28.827034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eaf83-ecf4-438b-a219-b403cda3b7e5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:28.827324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eaf83-ecf4-438b-a219-b403cda3b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:28.827601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eaf83-ecf4-438b-a219-b403cda3b7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:28.860336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5a1eaf83-ecf4-438b-a219-b403cda3b7e5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:28.861719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5a1eaf83-ecf4-438b-a219-b403cda3b7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:28.932163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89ec34-5ea0-4c1a-acac-ad64d45eac2a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:28.964583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:28.967203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c09881-e1d6-48c8-a093-4674e2701ca2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:28.967483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c09881-e1d6-48c8-a093-4674e2701ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:28.968520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c09881-e1d6-48c8-a093-4674e2701ca2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:28.972635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 15/28] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:28.979573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d5810-6995-42d8-b98d-a24524ba1b8f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:28.979853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d5810-6995-42d8-b98d-a24524ba1b8f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:28.980122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d5810-6995-42d8-b98d-a24524ba1b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.029060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-040d5810-6995-42d8-b98d-a24524ba1b8f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:29.030324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-040d5810-6995-42d8-b98d-a24524ba1b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:29.113167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:29.137422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 16/29] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:29.164576 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89ec34-5ea0-4c1a-acac-ad64d45eac2a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:29.177140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d5810-6995-42d8-b98d-a24524ba1b8f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:29.224399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934919a-68b4-4a8d-bda4-81513ce8d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:29.225385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934919a-68b4-4a8d-bda4-81513ce8d10a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:29.225839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934919a-68b4-4a8d-bda4-81513ce8d10a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:29.226275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934919a-68b4-4a8d-bda4-81513ce8d10a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.259105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:29.259401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934919a-68b4-4a8d-bda4-81513ce8d10a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3934919a-68b4-4a8d-bda4-81513ce8d10a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:29.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:29.266857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:29.267881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:29.269988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 14/30] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:10:29.285036 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934919a-68b4-4a8d-bda4-81513ce8d10a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:29.324480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d5810-6995-42d8-b98d-a24524ba1b8f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:29.388936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cfbeb-26a9-495b-bd74-c2a7d217599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:29.389680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cfbeb-26a9-495b-bd74-c2a7d217599b None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:29.389855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cfbeb-26a9-495b-bd74-c2a7d217599b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:29.390129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cfbeb-26a9-495b-bd74-c2a7d217599b None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.390838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cfbeb-26a9-495b-bd74-c2a7d217599b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:29.392366 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cfbeb-26a9-495b-bd74-c2a7d217599b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:29.419384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 17/31] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Oct 27 01:10:29 2022] POST /identity/v3/roles => generated 225 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:10:29.420785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cfbeb-26a9-495b-bd74-c2a7d217599b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:29.455590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934919a-68b4-4a8d-bda4-81513ce8d10a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:29.507678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211d22e-d1f3-4159-8550-819502d12585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:29.508667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211d22e-d1f3-4159-8550-819502d12585 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:29.509087 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211d22e-d1f3-4159-8550-819502d12585 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:29.509582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211d22e-d1f3-4159-8550-819502d12585 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.511706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211d22e-d1f3-4159-8550-819502d12585 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:29.512179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211d22e-d1f3-4159-8550-819502d12585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:29.514413 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211d22e-d1f3-4159-8550-819502d12585 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:29.527528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 15/32] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:29.532430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7654805-b894-434b-ac7a-03809e37d29a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:29.532430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7654805-b894-434b-ac7a-03809e37d29a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:29.532430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7654805-b894-434b-ac7a-03809e37d29a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.532430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:29.533251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7654805-b894-434b-ac7a-03809e37d29a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:29.539620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:29.555820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cfbeb-26a9-495b-bd74-c2a7d217599b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:29.585595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:29.614344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada6f5-fe71-497c-8c95-9cf66c846cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:29.615457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada6f5-fe71-497c-8c95-9cf66c846cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:29.615987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada6f5-fe71-497c-8c95-9cf66c846cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:29.616460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada6f5-fe71-497c-8c95-9cf66c846cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.631028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ada6f5-fe71-497c-8c95-9cf66c846cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:29.633064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ada6f5-fe71-497c-8c95-9cf66c846cd8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-f7ada6f5-fe71-497c-8c95-9cf66c846cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:10:29.652399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:29.653287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:10:29.654077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:10:29.654077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:10:29.654077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:29.654077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 18/34] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:29.655524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada6f5-fe71-497c-8c95-9cf66c846cd8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:29.674707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7654805-b894-434b-ac7a-03809e37d29a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:29.719172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba04565-4bfa-4129-a10b-7012ed5d8484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:29.720208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba04565-4bfa-4129-a10b-7012ed5d8484 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:29.720704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba04565-4bfa-4129-a10b-7012ed5d8484 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:29.722115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba04565-4bfa-4129-a10b-7012ed5d8484 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.723196 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba04565-4bfa-4129-a10b-7012ed5d8484 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:29.724826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba04565-4bfa-4129-a10b-7012ed5d8484 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:29.778858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada6f5-fe71-497c-8c95-9cf66c846cd8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:29.813415 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d20b8-1b5e-4963-ad7f-056eea57280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:29.814064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d20b8-1b5e-4963-ad7f-056eea57280f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:29.814347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d20b8-1b5e-4963-ad7f-056eea57280f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:29.814633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d20b8-1b5e-4963-ad7f-056eea57280f None admin] PATH_INFO: `/v3/users/b819844d641b4956ae9399e9c171524d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.815795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d20b8-1b5e-4963-ad7f-056eea57280f None admin] RBAC: Authorizing `identity:get_user(user_id=b819844d641b4956ae9399e9c171524d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:29.817536 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d20b8-1b5e-4963-ad7f-056eea57280f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:29.819190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 19/35] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:29 2022] GET /identity/v3/users/b819844d641b4956ae9399e9c171524d => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:29.820354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f75a3-5ace-441b-92b5-a2f99a91db3d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:29.820639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f75a3-5ace-441b-92b5-a2f99a91db3d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:29.820916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f75a3-5ace-441b-92b5-a2f99a91db3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.840138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-991f75a3-5ace-441b-92b5-a2f99a91db3d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:29.840138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-991f75a3-5ace-441b-92b5-a2f99a91db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:29.850529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 17/36] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Oct 27 01:10:29 2022] POST /identity/v3/roles => generated 219 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:29.851614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba04565-4bfa-4129-a10b-7012ed5d8484 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:29.884337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:29.922155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:29.939313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 20/37] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:29.939313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd125-4128-43ca-a012-ce7806d23750 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:29.939313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd125-4128-43ca-a012-ce7806d23750 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:29.939313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd125-4128-43ca-a012-ce7806d23750 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:29.939313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 21/38] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:29.939313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fd125-4128-43ca-a012-ce7806d23750 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:29.975695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba04565-4bfa-4129-a10b-7012ed5d8484 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:30.019575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1ba6-fb48-4d10-bb22-c430b3994f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:30.020528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1ba6-fb48-4d10-bb22-c430b3994f40 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:30.021061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1ba6-fb48-4d10-bb22-c430b3994f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:30.021543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1ba6-fb48-4d10-bb22-c430b3994f40 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:30.022380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f1ba6-fb48-4d10-bb22-c430b3994f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:30.022905 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f1ba6-fb48-4d10-bb22-c430b3994f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:30.024653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f1ba6-fb48-4d10-bb22-c430b3994f40 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:30.044323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 18/39] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:30.045957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37352a4e-3dde-4768-a284-46cc85abef92 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:30.046255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37352a4e-3dde-4768-a284-46cc85abef92 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:30.046579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37352a4e-3dde-4768-a284-46cc85abef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:30.066081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-37352a4e-3dde-4768-a284-46cc85abef92 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:30.067641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-37352a4e-3dde-4768-a284-46cc85abef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:30.091179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fd125-4128-43ca-a012-ce7806d23750 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:30.130694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131a93-9bed-4b77-89d7-40e17465e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:30.131382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131a93-9bed-4b77-89d7-40e17465e149 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:30.131659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131a93-9bed-4b77-89d7-40e17465e149 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:30.131986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131a93-9bed-4b77-89d7-40e17465e149 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:30.133152 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b131a93-9bed-4b77-89d7-40e17465e149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:30.134604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b131a93-9bed-4b77-89d7-40e17465e149 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:30.136615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 22/40] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:30.137443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131a93-9bed-4b77-89d7-40e17465e149 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:30.158271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 19/41] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:30.159244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37352a4e-3dde-4768-a284-46cc85abef92 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:30.191493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:30.218795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:30.261447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131a93-9bed-4b77-89d7-40e17465e149 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:30.266886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37352a4e-3dde-4768-a284-46cc85abef92 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:30.299645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005352e-e326-458e-9dd9-9a77416a25b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:30.300195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005352e-e326-458e-9dd9-9a77416a25b9 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:30.300476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005352e-e326-458e-9dd9-9a77416a25b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:30.300763 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005352e-e326-458e-9dd9-9a77416a25b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:30.301400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005352e-e326-458e-9dd9-9a77416a25b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:30.302146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd085cf-e120-4e7f-af73-84fccb7d9469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:30.302828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd085cf-e120-4e7f-af73-84fccb7d9469 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:30.302923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005352e-e326-458e-9dd9-9a77416a25b9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:30.303112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd085cf-e120-4e7f-af73-84fccb7d9469 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:30.303410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd085cf-e120-4e7f-af73-84fccb7d9469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:30.304148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd085cf-e120-4e7f-af73-84fccb7d9469 None admin] RBAC: Adding query filter params (role.id=72129dcc28d546169fd012284e4019ec, scope.domain.id=default, user.id=b819844d641b4956ae9399e9c171524d) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:30.304483 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd085cf-e120-4e7f-af73-84fccb7d9469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:30.305962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd085cf-e120-4e7f-af73-84fccb7d9469 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:30.313500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 20/42] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Oct 27 01:10:30 2022] GET /identity/v3/role_assignments?user.id=b819844d641b4956ae9399e9c171524d&scope.domain.id=default&role.id=72129dcc28d546169fd012284e4019ec => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:30.314137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd085cf-e120-4e7f-af73-84fccb7d9469 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:30.338860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 23/43] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:10:30 2022] POST /identity/v3/projects => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:30.451019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005352e-e326-458e-9dd9-9a77416a25b9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:30.462519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd085cf-e120-4e7f-af73-84fccb7d9469 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:30.485525 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:30.508500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68996f1-fe8c-4567-b320-4a8d92b19d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:30.509283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68996f1-fe8c-4567-b320-4a8d92b19d15 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:30.509630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68996f1-fe8c-4567-b320-4a8d92b19d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:30.509969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68996f1-fe8c-4567-b320-4a8d92b19d15 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:30.510742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68996f1-fe8c-4567-b320-4a8d92b19d15 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:30.512717 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68996f1-fe8c-4567-b320-4a8d92b19d15 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:30.531118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 21/44] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Oct 27 01:10:30 2022] POST /identity/v3/roles => generated 223 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:30.574408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:30.586614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005352e-e326-458e-9dd9-9a77416a25b9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:30.626877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc598c0-05fb-4656-af7f-981390f4cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:30.627549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc598c0-05fb-4656-af7f-981390f4cd0a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:30.627825 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc598c0-05fb-4656-af7f-981390f4cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:30.628099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc598c0-05fb-4656-af7f-981390f4cd0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:30.629264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc598c0-05fb-4656-af7f-981390f4cd0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:30.630748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc598c0-05fb-4656-af7f-981390f4cd0a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:30.632459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 24/45] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:10:30.639328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68996f1-fe8c-4567-b320-4a8d92b19d15 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:30.745211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68996f1-fe8c-4567-b320-4a8d92b19d15 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:30.779703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a7ae-e208-4666-9b58-e389f5b6033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:30.780327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a7ae-e208-4666-9b58-e389f5b6033d None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:30.780611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a7ae-e208-4666-9b58-e389f5b6033d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:30.780888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a7ae-e208-4666-9b58-e389f5b6033d None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:30.781558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695a7ae-e208-4666-9b58-e389f5b6033d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:30.783050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695a7ae-e208-4666-9b58-e389f5b6033d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:30.813823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:10:30 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:32.943020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796ef0-47b4-4e7d-acdc-91e54e054839 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:32.943583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796ef0-47b4-4e7d-acdc-91e54e054839 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:32.943583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796ef0-47b4-4e7d-acdc-91e54e054839 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:32.944961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 25/47] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:32.951417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eadc2-49b2-4867-a518-1ecac37f0665 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:32.952093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eadc2-49b2-4867-a518-1ecac37f0665 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:32.952285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eadc2-49b2-4867-a518-1ecac37f0665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:33.088879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-580eadc2-49b2-4867-a518-1ecac37f0665 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:33.090209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-580eadc2-49b2-4867-a518-1ecac37f0665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:33.122565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:33.171073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:33.437748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796ef0-47b4-4e7d-acdc-91e54e054839 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:33.545786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796ef0-47b4-4e7d-acdc-91e54e054839 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:33.590261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b5b4a-3298-4b60-b3aa-7b23d888d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:33.591265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b5b4a-3298-4b60-b3aa-7b23d888d182 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:33.591682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b5b4a-3298-4b60-b3aa-7b23d888d182 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:33.592075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b5b4a-3298-4b60-b3aa-7b23d888d182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:33.593937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b5b4a-3298-4b60-b3aa-7b23d888d182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:33.596257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b5b4a-3298-4b60-b3aa-7b23d888d182 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:33.598742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 26/49] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:33.604691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eadc2-49b2-4867-a518-1ecac37f0665 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:33.710152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eadc2-49b2-4867-a518-1ecac37f0665 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:33.745366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8409d-b31b-47d8-8ffd-75cbb7bec5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:33.745976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8409d-b31b-47d8-8ffd-75cbb7bec5b8 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:33.746255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8409d-b31b-47d8-8ffd-75cbb7bec5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:33.746509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8409d-b31b-47d8-8ffd-75cbb7bec5b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:33.747221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8409d-b31b-47d8-8ffd-75cbb7bec5b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:33.748672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8409d-b31b-47d8-8ffd-75cbb7bec5b8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:33.783492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 24/50] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Oct 27 01:10:33 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:35.901402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204f851-3023-410d-84a9-df73cbef683b None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:35.901903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204f851-3023-410d-84a9-df73cbef683b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:35.901903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204f851-3023-410d-84a9-df73cbef683b None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:35.903373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 27/51] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:35.909741 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07159b-727f-4a32-899c-dfa67a27ce04 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:35.910438 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07159b-727f-4a32-899c-dfa67a27ce04 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:35.910663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07159b-727f-4a32-899c-dfa67a27ce04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:35.931935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2c07159b-727f-4a32-899c-dfa67a27ce04 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:35.933138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2c07159b-727f-4a32-899c-dfa67a27ce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:35.936290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:36.006443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 25/52] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:36.283161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204f851-3023-410d-84a9-df73cbef683b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:36.315974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:36.390108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204f851-3023-410d-84a9-df73cbef683b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:36.424481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe3bb-d6a5-4971-a4e9-9534c28331d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:36.425110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe3bb-d6a5-4971-a4e9-9534c28331d8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:36.425397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe3bb-d6a5-4971-a4e9-9534c28331d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:36.425668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe3bb-d6a5-4971-a4e9-9534c28331d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:36.426942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebe3bb-d6a5-4971-a4e9-9534c28331d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:36.428400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebe3bb-d6a5-4971-a4e9-9534c28331d8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:36.430031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 28/53] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:36.435880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07159b-727f-4a32-899c-dfa67a27ce04 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:36.543327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07159b-727f-4a32-899c-dfa67a27ce04 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:36.578554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b66a2-8b26-4e3b-8364-3877883e2457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:36.579203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b66a2-8b26-4e3b-8364-3877883e2457 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:36.579481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b66a2-8b26-4e3b-8364-3877883e2457 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:36.579753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b66a2-8b26-4e3b-8364-3877883e2457 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:36.580404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b66a2-8b26-4e3b-8364-3877883e2457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:36.581868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b66a2-8b26-4e3b-8364-3877883e2457 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:36.601168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:36.613894 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 26/54] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:10:36 2022] POST /identity/v3/users => generated 275 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:39.871081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160469c-bba8-46cd-bf37-0381af367747 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:39.873719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160469c-bba8-46cd-bf37-0381af367747 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:39.873719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160469c-bba8-46cd-bf37-0381af367747 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:39.874227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 29/55] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:39.878999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8b6b5-5d14-408c-a054-564ef46fe2b2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:39.879395 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8b6b5-5d14-408c-a054-564ef46fe2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:39.879553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8b6b5-5d14-408c-a054-564ef46fe2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:39.897100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039ab58-bb9b-4f0e-af47-e3dcb0bb2fbd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:39.897688 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039ab58-bb9b-4f0e-af47-e3dcb0bb2fbd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:39.898170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039ab58-bb9b-4f0e-af47-e3dcb0bb2fbd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:39.899917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 30/56] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:10:39.902058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f7c8b6b5-5d14-408c-a054-564ef46fe2b2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:39.903577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f7c8b6b5-5d14-408c-a054-564ef46fe2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:39.904873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c7eca-3f88-459b-b5c0-b1ce26c18ea4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:39.905351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c7eca-3f88-459b-b5c0-b1ce26c18ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:39.905825 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c7eca-3f88-459b-b5c0-b1ce26c18ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:39.928962 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f27c7eca-3f88-459b-b5c0-b1ce26c18ea4 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:39.930557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f27c7eca-3f88-459b-b5c0-b1ce26c18ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:39.995084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 27/57] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:40.055626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 31/58] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:40.183383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2573-d37a-42f7-8f7d-a65ca16b62b3 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.184004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2573-d37a-42f7-8f7d-a65ca16b62b3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.184470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2573-d37a-42f7-8f7d-a65ca16b62b3 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.186271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 28/59] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:40.191631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d631eb-7856-42c7-8a47-e532ad49d536 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.192124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d631eb-7856-42c7-8a47-e532ad49d536 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.192598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d631eb-7856-42c7-8a47-e532ad49d536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.339190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d9d631eb-7856-42c7-8a47-e532ad49d536 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:40.340756 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d9d631eb-7856-42c7-8a47-e532ad49d536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:40.347278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c2573-d37a-42f7-8f7d-a65ca16b62b3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:40.365095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:40.415058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 32/60] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:40.416401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5c2a7-30eb-46ae-9d43-1ce364aad2d4 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.416690 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5c2a7-30eb-46ae-9d43-1ce364aad2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.416966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5c2a7-30eb-46ae-9d43-1ce364aad2d4 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.418211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 33/61] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:40.418918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5c2a7-30eb-46ae-9d43-1ce364aad2d4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:40.479818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c2573-d37a-42f7-8f7d-a65ca16b62b3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:40.518375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:40.530389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2704340-0564-45e0-93db-099439af9beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:40.531572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2704340-0564-45e0-93db-099439af9beb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.532215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2704340-0564-45e0-93db-099439af9beb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.532650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2704340-0564-45e0-93db-099439af9beb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.537595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5c2a7-30eb-46ae-9d43-1ce364aad2d4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:40.545131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2704340-0564-45e0-93db-099439af9beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e2704340-0564-45e0-93db-099439af9beb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:40.551393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:40.552421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:40.553370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 29/62] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:10:40.554135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec39c27-494c-4138-8a5a-8ca4ed175fe5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.554426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec39c27-494c-4138-8a5a-8ca4ed175fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.554750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec39c27-494c-4138-8a5a-8ca4ed175fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.584381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-aec39c27-494c-4138-8a5a-8ca4ed175fe5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:40.585886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aec39c27-494c-4138-8a5a-8ca4ed175fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:40.587147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7aab0-8c20-4742-ac3b-24cb87cd5aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:40.588432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7aab0-8c20-4742-ac3b-24cb87cd5aed None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.588884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7aab0-8c20-4742-ac3b-24cb87cd5aed None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.590133 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7aab0-8c20-4742-ac3b-24cb87cd5aed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.603945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7aab0-8c20-4742-ac3b-24cb87cd5aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-56e7aab0-8c20-4742-ac3b-24cb87cd5aed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:40.611512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:40.612407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:40.613242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 34/63] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:10:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:40.613860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7aab0-8c20-4742-ac3b-24cb87cd5aed None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:40.629732 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:40.659306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 30/64] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:40.660587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878a17-90e8-4261-8371-5f5b9040bd36 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.660878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878a17-90e8-4261-8371-5f5b9040bd36 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.661155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878a17-90e8-4261-8371-5f5b9040bd36 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.662399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 31/65] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:40.663116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1878a17-90e8-4261-8371-5f5b9040bd36 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:40.736906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7aab0-8c20-4742-ac3b-24cb87cd5aed None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:40.770649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1922c1-0146-4c54-a2f9-cec5b5f8d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:40.771293 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1922c1-0146-4c54-a2f9-cec5b5f8d571 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.771574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1922c1-0146-4c54-a2f9-cec5b5f8d571 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.771849 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1922c1-0146-4c54-a2f9-cec5b5f8d571 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.772519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1922c1-0146-4c54-a2f9-cec5b5f8d571 None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:40.772824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1922c1-0146-4c54-a2f9-cec5b5f8d571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:40.774266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1922c1-0146-4c54-a2f9-cec5b5f8d571 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:40.777010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1878a17-90e8-4261-8371-5f5b9040bd36 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:40.790644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 35/66] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:10:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:40.790644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd27e6-fbd9-454b-88ef-92f9442604ac None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.790644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd27e6-fbd9-454b-88ef-92f9442604ac None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.790644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd27e6-fbd9-454b-88ef-92f9442604ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.799543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:40.807153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-82cd27e6-fbd9-454b-88ef-92f9442604ac None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:40.808340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-82cd27e6-fbd9-454b-88ef-92f9442604ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:40.819188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442f39c-1868-48a0-97c3-5d41bb4fb0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:40.819813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442f39c-1868-48a0-97c3-5d41bb4fb0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.820098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442f39c-1868-48a0-97c3-5d41bb4fb0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.820413 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442f39c-1868-48a0-97c3-5d41bb4fb0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.821072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442f39c-1868-48a0-97c3-5d41bb4fb0b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:40.821379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442f39c-1868-48a0-97c3-5d41bb4fb0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:40.822808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442f39c-1868-48a0-97c3-5d41bb4fb0b4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:40.834106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 32/67] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:40.835217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442f39c-1868-48a0-97c3-5d41bb4fb0b4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:40.883434 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 36/68] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:40.884490 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd27e6-fbd9-454b-88ef-92f9442604ac None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:40.893263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:40.959026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442f39c-1868-48a0-97c3-5d41bb4fb0b4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:40.995105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154b187-64c2-42fc-8b13-3f66bcce041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:40.996220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154b187-64c2-42fc-8b13-3f66bcce041f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:40.996508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154b187-64c2-42fc-8b13-3f66bcce041f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:40.996767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154b187-64c2-42fc-8b13-3f66bcce041f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:40.998311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd27e6-fbd9-454b-88ef-92f9442604ac None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.007095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154b187-64c2-42fc-8b13-3f66bcce041f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f154b187-64c2-42fc-8b13-3f66bcce041f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:41.013586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:41.014619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:10:41.015481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:41.016061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 33/69] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:10:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:41.016712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154b187-64c2-42fc-8b13-3f66bcce041f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.041151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b3be6-a844-4cc6-bac4-23a27fd6a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.041806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b3be6-a844-4cc6-bac4-23a27fd6a0ed None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.042089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b3be6-a844-4cc6-bac4-23a27fd6a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.042367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b3be6-a844-4cc6-bac4-23a27fd6a0ed None admin] PATH_INFO: `/v3/users/1a8107b76594433a880dd6fc78bcd6d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.057485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b3be6-a844-4cc6-bac4-23a27fd6a0ed None admin] RBAC: Authorizing `identity:get_user(user_id=1a8107b76594433a880dd6fc78bcd6d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.058995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b3be6-a844-4cc6-bac4-23a27fd6a0ed None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.059909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:41.060761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 37/70] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:40 2022] GET /identity/v3/users/1a8107b76594433a880dd6fc78bcd6d2 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:41.061734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b3be6-a844-4cc6-bac4-23a27fd6a0ed None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.122803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:41.135403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154b187-64c2-42fc-8b13-3f66bcce041f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.165183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b3be6-a844-4cc6-bac4-23a27fd6a0ed None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.169575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351fef9-477e-43ad-af75-ea3e9ecb24b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.170219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351fef9-477e-43ad-af75-ea3e9ecb24b0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.170499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351fef9-477e-43ad-af75-ea3e9ecb24b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.170802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351fef9-477e-43ad-af75-ea3e9ecb24b0 None admin] PATH_INFO: `/v3/users/b819844d641b4956ae9399e9c171524d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.171984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351fef9-477e-43ad-af75-ea3e9ecb24b0 None admin] RBAC: Authorizing `identity:get_user(user_id=b819844d641b4956ae9399e9c171524d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.173434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351fef9-477e-43ad-af75-ea3e9ecb24b0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.175069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 34/71] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:41 2022] GET /identity/v3/users/b819844d641b4956ae9399e9c171524d => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:41.175834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351fef9-477e-43ad-af75-ea3e9ecb24b0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.199191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69039862-1818-49ec-bfff-703a609322b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.199831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69039862-1818-49ec-bfff-703a609322b9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.200110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69039862-1818-49ec-bfff-703a609322b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.200423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69039862-1818-49ec-bfff-703a609322b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.211004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69039862-1818-49ec-bfff-703a609322b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-69039862-1818-49ec-bfff-703a609322b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:41.215999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:41.216875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:41.217635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 38/72] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:41.218327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69039862-1818-49ec-bfff-703a609322b9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.276689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351fef9-477e-43ad-af75-ea3e9ecb24b0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.283941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:41.310885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba65c6-4a4c-4128-8596-ec924322a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.311701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba65c6-4a4c-4128-8596-ec924322a29a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.311980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba65c6-4a4c-4128-8596-ec924322a29a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.312256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba65c6-4a4c-4128-8596-ec924322a29a None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.312935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba65c6-4a4c-4128-8596-ec924322a29a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:41.313238 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba65c6-4a4c-4128-8596-ec924322a29a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.314621 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba65c6-4a4c-4128-8596-ec924322a29a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.316645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69039862-1818-49ec-bfff-703a609322b9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.322330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 35/73] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:10:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:41.323145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba65c6-4a4c-4128-8596-ec924322a29a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.339803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:41.351021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8060b3-4438-4aa9-b3e3-9d8ca600b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.351666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8060b3-4438-4aa9-b3e3-9d8ca600b868 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.352268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8060b3-4438-4aa9-b3e3-9d8ca600b868 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.352268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8060b3-4438-4aa9-b3e3-9d8ca600b868 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.353509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8060b3-4438-4aa9-b3e3-9d8ca600b868 None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.355016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8060b3-4438-4aa9-b3e3-9d8ca600b868 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.356814 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 39/74] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:41 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:41.357493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8060b3-4438-4aa9-b3e3-9d8ca600b868 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.424221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba65c6-4a4c-4128-8596-ec924322a29a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.455847 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8060b3-4438-4aa9-b3e3-9d8ca600b868 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.459060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6538b0-53d4-45a3-ae45-8535d7d5ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.459705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6538b0-53d4-45a3-ae45-8535d7d5ba51 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.459985 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6538b0-53d4-45a3-ae45-8535d7d5ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.460258 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6538b0-53d4-45a3-ae45-8535d7d5ba51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.461444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6538b0-53d4-45a3-ae45-8535d7d5ba51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.463311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6538b0-53d4-45a3-ae45-8535d7d5ba51 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.465246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 36/75] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:41.466302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6538b0-53d4-45a3-ae45-8535d7d5ba51 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.491186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a267909-7c93-4e4e-9e24-fcdc1a0367b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.491826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a267909-7c93-4e4e-9e24-fcdc1a0367b7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.492122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a267909-7c93-4e4e-9e24-fcdc1a0367b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.492713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a267909-7c93-4e4e-9e24-fcdc1a0367b7 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.493566 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a267909-7c93-4e4e-9e24-fcdc1a0367b7 None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.495043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a267909-7c93-4e4e-9e24-fcdc1a0367b7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.496661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 40/76] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:41 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:41.502016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:41.502190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a267909-7c93-4e4e-9e24-fcdc1a0367b7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.559938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:41.566078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6538b0-53d4-45a3-ae45-8535d7d5ba51 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.598974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ab45-c3d1-4358-bab0-a609a48a5466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.599596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ab45-c3d1-4358-bab0-a609a48a5466 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.599850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a267909-7c93-4e4e-9e24-fcdc1a0367b7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.599947 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ab45-c3d1-4358-bab0-a609a48a5466 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.600150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ab45-c3d1-4358-bab0-a609a48a5466 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.600813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4ab45-c3d1-4358-bab0-a609a48a5466 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:41.601121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4ab45-c3d1-4358-bab0-a609a48a5466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.602570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4ab45-c3d1-4358-bab0-a609a48a5466 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.610900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 37/77] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:10:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:41.611737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ab45-c3d1-4358-bab0-a609a48a5466 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.639057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064734f1-a32e-4443-9b02-293406948da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.639728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064734f1-a32e-4443-9b02-293406948da6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.640005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064734f1-a32e-4443-9b02-293406948da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.640278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064734f1-a32e-4443-9b02-293406948da6 None admin] PATH_INFO: `/v3/users/1a8107b76594433a880dd6fc78bcd6d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.641445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064734f1-a32e-4443-9b02-293406948da6 None admin] RBAC: Authorizing `identity:get_user(user_id=1a8107b76594433a880dd6fc78bcd6d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.642952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064734f1-a32e-4443-9b02-293406948da6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.644495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 41/78] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:41 2022] GET /identity/v3/users/1a8107b76594433a880dd6fc78bcd6d2 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:41.645300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064734f1-a32e-4443-9b02-293406948da6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.707963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:41.711980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ab45-c3d1-4358-bab0-a609a48a5466 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.743561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064734f1-a32e-4443-9b02-293406948da6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.746693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59b7b-fbad-4de5-8cdd-7dd195334c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.747390 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59b7b-fbad-4de5-8cdd-7dd195334c7f None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.747677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59b7b-fbad-4de5-8cdd-7dd195334c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.747952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59b7b-fbad-4de5-8cdd-7dd195334c7f None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51/users/1a8107b76594433a880dd6fc78bcd6d2/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.749924 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d59b7b-fbad-4de5-8cdd-7dd195334c7f None admin] RBAC: Authorizing `identity:create_grant(project_id=d297e3933cee44408a03ee5029e09d51, user_id=1a8107b76594433a880dd6fc78bcd6d2, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.751432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d59b7b-fbad-4de5-8cdd-7dd195334c7f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.767352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 38/79] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:10:41 2022] PUT /identity/v3/projects/d297e3933cee44408a03ee5029e09d51/users/1a8107b76594433a880dd6fc78bcd6d2/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:10:41.771913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59b7b-fbad-4de5-8cdd-7dd195334c7f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.773668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:41.783374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25b53-7461-4e9a-8b92-a7785ae4e937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.784069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25b53-7461-4e9a-8b92-a7785ae4e937 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.784348 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25b53-7461-4e9a-8b92-a7785ae4e937 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.784629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25b53-7461-4e9a-8b92-a7785ae4e937 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.785442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25b53-7461-4e9a-8b92-a7785ae4e937 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.786924 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25b53-7461-4e9a-8b92-a7785ae4e937 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:41.830846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 42/80] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:10:41 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:41.830846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25b53-7461-4e9a-8b92-a7785ae4e937 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:41.934834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59b7b-fbad-4de5-8cdd-7dd195334c7f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.967078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25b53-7461-4e9a-8b92-a7785ae4e937 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:41.984188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d445cb-41e2-44e3-9f98-6e9c8ec59974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:41.985419 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d445cb-41e2-44e3-9f98-6e9c8ec59974 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:41.985700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d445cb-41e2-44e3-9f98-6e9c8ec59974 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:41.986130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d445cb-41e2-44e3-9f98-6e9c8ec59974 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51/users/b819844d641b4956ae9399e9c171524d/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:41.988317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d445cb-41e2-44e3-9f98-6e9c8ec59974 None admin] RBAC: Authorizing `identity:create_grant(project_id=d297e3933cee44408a03ee5029e09d51, user_id=b819844d641b4956ae9399e9c171524d, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:41.989816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d445cb-41e2-44e3-9f98-6e9c8ec59974 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:42.007736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 39/81] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:10:41 2022] PUT /identity/v3/projects/d297e3933cee44408a03ee5029e09d51/users/b819844d641b4956ae9399e9c171524d/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:10:42.009657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72699b9-da09-48b3-81cc-aa40efece050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:42.010568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72699b9-da09-48b3-81cc-aa40efece050 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:42.011072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72699b9-da09-48b3-81cc-aa40efece050 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:42.011907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72699b9-da09-48b3-81cc-aa40efece050 None admin] PATH_INFO: `/v3/users/1a8107b76594433a880dd6fc78bcd6d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:42.013440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72699b9-da09-48b3-81cc-aa40efece050 None admin] RBAC: Authorizing `identity:get_user(user_id=1a8107b76594433a880dd6fc78bcd6d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:42.015252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72699b9-da09-48b3-81cc-aa40efece050 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:42.015706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d445cb-41e2-44e3-9f98-6e9c8ec59974 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:42.017783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 43/82] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:41 2022] GET /identity/v3/users/1a8107b76594433a880dd6fc78bcd6d2 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:42.023476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72699b9-da09-48b3-81cc-aa40efece050 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:42.045526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:42.088169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:42.156519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72699b9-da09-48b3-81cc-aa40efece050 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:42.182158 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d445cb-41e2-44e3-9f98-6e9c8ec59974 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:42.202655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed501a4-07fb-4310-b05c-12eeb7298056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:42.203406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed501a4-07fb-4310-b05c-12eeb7298056 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:42.203609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed501a4-07fb-4310-b05c-12eeb7298056 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:42.203872 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed501a4-07fb-4310-b05c-12eeb7298056 None admin] PATH_INFO: `/v3/projects/7900aafc484d4e328c936cf845d5a328` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:42.205067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed501a4-07fb-4310-b05c-12eeb7298056 None admin] RBAC: Authorizing `identity:get_project(project_id=7900aafc484d4e328c936cf845d5a328)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:42.206525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed501a4-07fb-4310-b05c-12eeb7298056 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:42.208971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 44/83] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:42 2022] GET /identity/v3/projects/7900aafc484d4e328c936cf845d5a328 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:10:42.216038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed501a4-07fb-4310-b05c-12eeb7298056 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:42.238390 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03394de0-c371-4982-921d-1bb0918bc760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:42.242156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03394de0-c371-4982-921d-1bb0918bc760 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:42.242156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03394de0-c371-4982-921d-1bb0918bc760 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:42.242156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03394de0-c371-4982-921d-1bb0918bc760 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:42.242479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03394de0-c371-4982-921d-1bb0918bc760 None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:42.243830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03394de0-c371-4982-921d-1bb0918bc760 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:42.245878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 40/84] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:42 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:42.252980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03394de0-c371-4982-921d-1bb0918bc760 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:42.339438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed501a4-07fb-4310-b05c-12eeb7298056 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:42.362409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:42.364435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:42.378084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3575fe-8461-4ab1-acac-460a0760a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:42.379127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3575fe-8461-4ab1-acac-460a0760a0fa None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:42.379552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3575fe-8461-4ab1-acac-460a0760a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:42.379966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3575fe-8461-4ab1-acac-460a0760a0fa None admin] PATH_INFO: `/v3/projects/7900aafc484d4e328c936cf845d5a328/users/1a8107b76594433a880dd6fc78bcd6d2/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:42.382589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3575fe-8461-4ab1-acac-460a0760a0fa None admin] RBAC: Authorizing `identity:create_grant(project_id=7900aafc484d4e328c936cf845d5a328, user_id=1a8107b76594433a880dd6fc78bcd6d2, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:42.384292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3575fe-8461-4ab1-acac-460a0760a0fa None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:42.385274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03394de0-c371-4982-921d-1bb0918bc760 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:42.405337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 45/85] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:10:42 2022] PUT /identity/v3/projects/7900aafc484d4e328c936cf845d5a328/users/1a8107b76594433a880dd6fc78bcd6d2/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:10:42.432062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc4e76-23c4-4fbb-80bd-ca25fc7fb589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:42.432062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc4e76-23c4-4fbb-80bd-ca25fc7fb589 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:42.432062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc4e76-23c4-4fbb-80bd-ca25fc7fb589 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:42.432408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc4e76-23c4-4fbb-80bd-ca25fc7fb589 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51/users/1a8107b76594433a880dd6fc78bcd6d2/roles/375d0d25eaa04686ba41303116106916` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:42.434775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc4e76-23c4-4fbb-80bd-ca25fc7fb589 None admin] RBAC: Authorizing `identity:create_grant(project_id=d297e3933cee44408a03ee5029e09d51, user_id=1a8107b76594433a880dd6fc78bcd6d2, role_id=375d0d25eaa04686ba41303116106916)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:42.436345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc4e76-23c4-4fbb-80bd-ca25fc7fb589 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:42.454598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 41/86] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:10:42 2022] PUT /identity/v3/projects/d297e3933cee44408a03ee5029e09d51/users/1a8107b76594433a880dd6fc78bcd6d2/roles/375d0d25eaa04686ba41303116106916 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:10:44.388353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab9b93-0bb6-4bce-bf3f-d3e0bbd46a89 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:44.389366 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab9b93-0bb6-4bce-bf3f-d3e0bbd46a89 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:44.389858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab9b93-0bb6-4bce-bf3f-d3e0bbd46a89 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:44.391494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 46/87] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:44.396918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18777e00-5f5a-4eff-a94a-e1c7dd0db0bd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:44.397316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18777e00-5f5a-4eff-a94a-e1c7dd0db0bd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:44.397477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18777e00-5f5a-4eff-a94a-e1c7dd0db0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:44.424353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-18777e00-5f5a-4eff-a94a-e1c7dd0db0bd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:44.425572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-18777e00-5f5a-4eff-a94a-e1c7dd0db0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:44.516213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 42/88] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:10:44.928107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d19e5-2f20-4bdc-a04f-7c13fbbc5029 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:44.928751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d19e5-2f20-4bdc-a04f-7c13fbbc5029 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:44.929257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d19e5-2f20-4bdc-a04f-7c13fbbc5029 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:44.930879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 47/89] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:44.936486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91217df-5902-459c-afdf-e62d34d75790 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:44.937006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91217df-5902-459c-afdf-e62d34d75790 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:44.937463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91217df-5902-459c-afdf-e62d34d75790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:44.968696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b91217df-5902-459c-afdf-e62d34d75790 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:44.970381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b91217df-5902-459c-afdf-e62d34d75790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:45.059215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d19e5-2f20-4bdc-a04f-7c13fbbc5029 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:45.062191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 43/90] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:45.220544 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d19e5-2f20-4bdc-a04f-7c13fbbc5029 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:45.269024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2ade9-67ed-41ba-ae3c-8ce40dd9aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:45.269676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2ade9-67ed-41ba-ae3c-8ce40dd9aba5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.269958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2ade9-67ed-41ba-ae3c-8ce40dd9aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.270230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2ade9-67ed-41ba-ae3c-8ce40dd9aba5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.285134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2ade9-67ed-41ba-ae3c-8ce40dd9aba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-19d2ade9-67ed-41ba-ae3c-8ce40dd9aba5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:45.290531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:45.291421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:45.292595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 48/91] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:10:45.298923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91217df-5902-459c-afdf-e62d34d75790 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:45.313229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:45.488933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91217df-5902-459c-afdf-e62d34d75790 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:45.540542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d179e-5c57-4f21-a5cd-48b9fad94221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:45.541188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d179e-5c57-4f21-a5cd-48b9fad94221 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.541467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d179e-5c57-4f21-a5cd-48b9fad94221 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.541797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d179e-5c57-4f21-a5cd-48b9fad94221 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.542491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d179e-5c57-4f21-a5cd-48b9fad94221 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:45.542885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d179e-5c57-4f21-a5cd-48b9fad94221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:45.544266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d179e-5c57-4f21-a5cd-48b9fad94221 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:45.558375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 44/92] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:10:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:45.564426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2ade9-67ed-41ba-ae3c-8ce40dd9aba5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:45.610382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171baed-b435-479c-aa84-447bdfe6cc62 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.610743 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171baed-b435-479c-aa84-447bdfe6cc62 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.610971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171baed-b435-479c-aa84-447bdfe6cc62 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.613007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 45/93] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:45.619024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fd0c4-1925-4230-8997-46a51f7c5c93 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.619307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fd0c4-1925-4230-8997-46a51f7c5c93 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.619597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fd0c4-1925-4230-8997-46a51f7c5c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.633113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:45.649076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2b4fd0c4-1925-4230-8997-46a51f7c5c93 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:45.650351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2b4fd0c4-1925-4230-8997-46a51f7c5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:45.745858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2ade9-67ed-41ba-ae3c-8ce40dd9aba5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:45.784174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:45.788496 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaca941-cd44-4da2-b3e2-60627520a00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:45.789301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaca941-cd44-4da2-b3e2-60627520a00a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.789647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaca941-cd44-4da2-b3e2-60627520a00a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.789991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaca941-cd44-4da2-b3e2-60627520a00a None admin] PATH_INFO: `/v3/users/1a8107b76594433a880dd6fc78bcd6d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.791380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaca941-cd44-4da2-b3e2-60627520a00a None admin] RBAC: Authorizing `identity:get_user(user_id=1a8107b76594433a880dd6fc78bcd6d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:45.792874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaca941-cd44-4da2-b3e2-60627520a00a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:45.793236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 46/94] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:45.795181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 49/95] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:45 2022] GET /identity/v3/users/1a8107b76594433a880dd6fc78bcd6d2 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:45.796359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa6d7b-0ffa-491c-9ec7-d156f0956b5c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.796626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa6d7b-0ffa-491c-9ec7-d156f0956b5c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.796894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa6d7b-0ffa-491c-9ec7-d156f0956b5c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.798322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 50/96] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:45.799259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b32f1-5ab5-4bb1-b0f3-b0d4c15138c6 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.799365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fd0c4-1925-4230-8997-46a51f7c5c93 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:45.799540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b32f1-5ab5-4bb1-b0f3-b0d4c15138c6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.799813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b32f1-5ab5-4bb1-b0f3-b0d4c15138c6 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.801256 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 51/97] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:45.803329 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b32f1-5ab5-4bb1-b0f3-b0d4c15138c6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:45.918194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b32f1-5ab5-4bb1-b0f3-b0d4c15138c6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:45.923095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fd0c4-1925-4230-8997-46a51f7c5c93 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:45.928031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:45.955198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3502b-028c-49c5-8ebf-028dd57207d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:45.955857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3502b-028c-49c5-8ebf-028dd57207d7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.956137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3502b-028c-49c5-8ebf-028dd57207d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.956493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3502b-028c-49c5-8ebf-028dd57207d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.957902 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a9b5f-ce10-46eb-a492-4dad8e47cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:45.958552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a9b5f-ce10-46eb-a492-4dad8e47cc58 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.958882 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a9b5f-ce10-46eb-a492-4dad8e47cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.959168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a9b5f-ce10-46eb-a492-4dad8e47cc58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.969287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a9b5f-ce10-46eb-a492-4dad8e47cc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-368a9b5f-ce10-46eb-a492-4dad8e47cc58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:45.974191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:45.975084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:45.976043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 47/98] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:45.977817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ed82b-454a-4e4a-a8a7-8b2fcfeafeda None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:45.978102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ed82b-454a-4e4a-a8a7-8b2fcfeafeda None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:45.978378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ed82b-454a-4e4a-a8a7-8b2fcfeafeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:45.995689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c07ed82b-454a-4e4a-a8a7-8b2fcfeafeda None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:45.996953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c07ed82b-454a-4e4a-a8a7-8b2fcfeafeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:46.038140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3502b-028c-49c5-8ebf-028dd57207d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:46.040133 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3502b-028c-49c5-8ebf-028dd57207d7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:46.052788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:46.068196 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 48/99] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:46.069618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e84c32-fb94-4e64-b31d-a237b1cfd61b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.069938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e84c32-fb94-4e64-b31d-a237b1cfd61b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.070176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e84c32-fb94-4e64-b31d-a237b1cfd61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.087741 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d9e84c32-fb94-4e64-b31d-a237b1cfd61b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:46.088914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d9e84c32-fb94-4e64-b31d-a237b1cfd61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:46.144677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 52/100] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 01:10:46.145902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e49891-8ed9-4f66-b74f-7326724e6c72 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.146185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e49891-8ed9-4f66-b74f-7326724e6c72 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.146470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e49891-8ed9-4f66-b74f-7326724e6c72 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.147860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 53/101] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:46.148538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e49891-8ed9-4f66-b74f-7326724e6c72 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.159502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:46.167414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 49/102] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:46.168475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e84c32-fb94-4e64-b31d-a237b1cfd61b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.266802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e49891-8ed9-4f66-b74f-7326724e6c72 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:46.301310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e84c32-fb94-4e64-b31d-a237b1cfd61b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:46.303328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8db595-c8d2-4ea3-9999-35bb30878202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:46.304228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8db595-c8d2-4ea3-9999-35bb30878202 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.304810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8db595-c8d2-4ea3-9999-35bb30878202 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.305295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8db595-c8d2-4ea3-9999-35bb30878202 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.306146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8db595-c8d2-4ea3-9999-35bb30878202 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:46.306635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8db595-c8d2-4ea3-9999-35bb30878202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:46.308238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8db595-c8d2-4ea3-9999-35bb30878202 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:46.317551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 54/103] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:46.318667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8db595-c8d2-4ea3-9999-35bb30878202 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.326820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:46.345730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e2aa6-e43c-40e3-8b71-e89af5de8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:46.346391 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2aa6-e43c-40e3-8b71-e89af5de8cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.346659 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2aa6-e43c-40e3-8b71-e89af5de8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.346967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2aa6-e43c-40e3-8b71-e89af5de8cf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.357507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e2aa6-e43c-40e3-8b71-e89af5de8cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-026e2aa6-e43c-40e3-8b71-e89af5de8cf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:46.362325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:46.363226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:46.363972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 50/104] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:10:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:46.364595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeddb83-5163-4861-882b-ef5dae3ce3a3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.365337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeddb83-5163-4861-882b-ef5dae3ce3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.365613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeddb83-5163-4861-882b-ef5dae3ce3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.382915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-dfeddb83-5163-4861-882b-ef5dae3ce3a3 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:46.384090 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dfeddb83-5163-4861-882b-ef5dae3ce3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:46.401930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:46.434860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8db595-c8d2-4ea3-9999-35bb30878202 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:46.452437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 51/105] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:46.453348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeddb83-5163-4861-882b-ef5dae3ce3a3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.469881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0703e8-ee9a-45ef-983e-80f9292fff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:46.470858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0703e8-ee9a-45ef-983e-80f9292fff45 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.471356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0703e8-ee9a-45ef-983e-80f9292fff45 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.471830 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0703e8-ee9a-45ef-983e-80f9292fff45 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.473078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0703e8-ee9a-45ef-983e-80f9292fff45 None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:46.474628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0703e8-ee9a-45ef-983e-80f9292fff45 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:46.476691 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 55/106] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:46 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:46.477448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0703e8-ee9a-45ef-983e-80f9292fff45 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.565974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeddb83-5163-4861-882b-ef5dae3ce3a3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:46.575490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:46.585229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0703e8-ee9a-45ef-983e-80f9292fff45 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:46.602583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ff14d-d4cf-4199-97d2-a3d7e9916af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:46.603432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ff14d-d4cf-4199-97d2-a3d7e9916af9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.603768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ff14d-d4cf-4199-97d2-a3d7e9916af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.604112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ff14d-d4cf-4199-97d2-a3d7e9916af9 None admin] PATH_INFO: `/v3/users/b819844d641b4956ae9399e9c171524d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.605318 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ff14d-d4cf-4199-97d2-a3d7e9916af9 None admin] RBAC: Authorizing `identity:get_user(user_id=b819844d641b4956ae9399e9c171524d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:46.606993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ff14d-d4cf-4199-97d2-a3d7e9916af9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:46.608876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 52/107] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:46 2022] GET /identity/v3/users/b819844d641b4956ae9399e9c171524d => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:46.609485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ff14d-d4cf-4199-97d2-a3d7e9916af9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.623871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c73fbf-0658-49da-adbf-97baaf152375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:46.624583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c73fbf-0658-49da-adbf-97baaf152375 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.624925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c73fbf-0658-49da-adbf-97baaf152375 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.625262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c73fbf-0658-49da-adbf-97baaf152375 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.626433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c73fbf-0658-49da-adbf-97baaf152375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:46.628005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c73fbf-0658-49da-adbf-97baaf152375 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:46.629892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 56/108] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:46.630608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c73fbf-0658-49da-adbf-97baaf152375 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.643619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:46.719417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ff14d-d4cf-4199-97d2-a3d7e9916af9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:46.738678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c73fbf-0658-49da-adbf-97baaf152375 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:46.752124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f108954-cca9-4fb5-a496-e9312ef85e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:46.752856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f108954-cca9-4fb5-a496-e9312ef85e9d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.753209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f108954-cca9-4fb5-a496-e9312ef85e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.753495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f108954-cca9-4fb5-a496-e9312ef85e9d None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.754185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f108954-cca9-4fb5-a496-e9312ef85e9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:46.754491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f108954-cca9-4fb5-a496-e9312ef85e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:46.755922 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f108954-cca9-4fb5-a496-e9312ef85e9d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:46.764572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 53/109] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:10:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:46.765357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f108954-cca9-4fb5-a496-e9312ef85e9d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.773058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f0610-8d21-495c-9083-11f1518d1a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:46.773805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f0610-8d21-495c-9083-11f1518d1a0b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.774086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f0610-8d21-495c-9083-11f1518d1a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.774362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f0610-8d21-495c-9083-11f1518d1a0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.784800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f0610-8d21-495c-9083-11f1518d1a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c96f0610-8d21-495c-9083-11f1518d1a0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:46.790134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:46.791205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:46.791992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 57/110] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:46.792624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f0610-8d21-495c-9083-11f1518d1a0b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.808008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:46.857227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:46.867831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f108954-cca9-4fb5-a496-e9312ef85e9d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:46.891495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f0610-8d21-495c-9083-11f1518d1a0b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:46.901721 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b1c5-d69c-4a73-8d49-a2931356e0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:46.902334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b1c5-d69c-4a73-8d49-a2931356e0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.902616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b1c5-d69c-4a73-8d49-a2931356e0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.902917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b1c5-d69c-4a73-8d49-a2931356e0f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:46.903662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b1c5-d69c-4a73-8d49-a2931356e0f8 None admin] RBAC: Adding query filter params (role.id=9145b5c6668a409d854e7d0c4491d775, scope.project.id=d297e3933cee44408a03ee5029e09d51, user.id=1a8107b76594433a880dd6fc78bcd6d2) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:46.903974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b1c5-d69c-4a73-8d49-a2931356e0f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:46.905429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b1c5-d69c-4a73-8d49-a2931356e0f8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:46.911088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 54/111] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:10:46 2022] GET /identity/v3/role_assignments?user.id=1a8107b76594433a880dd6fc78bcd6d2&scope.project.id=d297e3933cee44408a03ee5029e09d51&role.id=9145b5c6668a409d854e7d0c4491d775 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:46.911839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b1c5-d69c-4a73-8d49-a2931356e0f8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:46.932939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a3b3d-5775-4c84-b8cd-5cab713b2999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:46.933576 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a3b3d-5775-4c84-b8cd-5cab713b2999 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:46.933858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a3b3d-5775-4c84-b8cd-5cab713b2999 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:46.934134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a3b3d-5775-4c84-b8cd-5cab713b2999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.015202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a3b3d-5775-4c84-b8cd-5cab713b2999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.016874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a3b3d-5775-4c84-b8cd-5cab713b2999 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.023908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b1c5-d69c-4a73-8d49-a2931356e0f8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.025579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:47.062705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaefc33-c82e-4101-9cd0-a41b091226e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.063374 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaefc33-c82e-4101-9cd0-a41b091226e2 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.063665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaefc33-c82e-4101-9cd0-a41b091226e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.063951 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaefc33-c82e-4101-9cd0-a41b091226e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.064630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaefc33-c82e-4101-9cd0-a41b091226e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.066128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaefc33-c82e-4101-9cd0-a41b091226e2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.088731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:47.099386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 55/112] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:10:46 2022] POST /identity/v3/projects => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:47.100425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaefc33-c82e-4101-9cd0-a41b091226e2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.135887 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 58/113] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:10:47.137231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a3b3d-5775-4c84-b8cd-5cab713b2999 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.233677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaefc33-c82e-4101-9cd0-a41b091226e2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.262560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a3b3d-5775-4c84-b8cd-5cab713b2999 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.270032 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6958b-3104-4a6b-bf9c-7980ad18acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.270695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6958b-3104-4a6b-bf9c-7980ad18acaf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.271008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6958b-3104-4a6b-bf9c-7980ad18acaf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.271282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6958b-3104-4a6b-bf9c-7980ad18acaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.282526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6958b-3104-4a6b-bf9c-7980ad18acaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-55f6958b-3104-4a6b-bf9c-7980ad18acaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:47.287584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:47.288443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:47.289314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 56/114] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:47.289936 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6958b-3104-4a6b-bf9c-7980ad18acaf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.309013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940e538-3255-46a4-a603-ce0d918f80bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.309668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940e538-3255-46a4-a603-ce0d918f80bd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.309968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940e538-3255-46a4-a603-ce0d918f80bd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.310604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940e538-3255-46a4-a603-ce0d918f80bd None admin] PATH_INFO: `/v3/users/1a8107b76594433a880dd6fc78bcd6d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.311534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:47.312622 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940e538-3255-46a4-a603-ce0d918f80bd None admin] RBAC: Authorizing `identity:get_user(user_id=1a8107b76594433a880dd6fc78bcd6d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.314310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940e538-3255-46a4-a603-ce0d918f80bd None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.316019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 59/115] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/users/1a8107b76594433a880dd6fc78bcd6d2 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:47.316984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940e538-3255-46a4-a603-ce0d918f80bd None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.355271 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:47.408557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6958b-3104-4a6b-bf9c-7980ad18acaf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.425506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940e538-3255-46a4-a603-ce0d918f80bd None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.445227 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81ed1-9603-4fc4-a3f0-a5d84fa62712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.445884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81ed1-9603-4fc4-a3f0-a5d84fa62712 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.446166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81ed1-9603-4fc4-a3f0-a5d84fa62712 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.446437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81ed1-9603-4fc4-a3f0-a5d84fa62712 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.447518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de81ed1-9603-4fc4-a3f0-a5d84fa62712 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:47.447518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de81ed1-9603-4fc4-a3f0-a5d84fa62712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.448834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de81ed1-9603-4fc4-a3f0-a5d84fa62712 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.458509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 57/116] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:47.459263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81ed1-9603-4fc4-a3f0-a5d84fa62712 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.465957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714ede9-4dca-4639-87f7-4c4f0b5b05ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.466612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714ede9-4dca-4639-87f7-4c4f0b5b05ad None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.466920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714ede9-4dca-4639-87f7-4c4f0b5b05ad None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.467193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714ede9-4dca-4639-87f7-4c4f0b5b05ad None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.468322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714ede9-4dca-4639-87f7-4c4f0b5b05ad None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.469774 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714ede9-4dca-4639-87f7-4c4f0b5b05ad None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.476334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 60/117] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:47.476334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714ede9-4dca-4639-87f7-4c4f0b5b05ad None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.545945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:47.572830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81ed1-9603-4fc4-a3f0-a5d84fa62712 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.577273 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714ede9-4dca-4639-87f7-4c4f0b5b05ad None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.578791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:47.610130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ca5cb-63f3-40e2-a4da-1d9e84dad849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.610667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ca5cb-63f3-40e2-a4da-1d9e84dad849 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.610981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ca5cb-63f3-40e2-a4da-1d9e84dad849 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.611252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ca5cb-63f3-40e2-a4da-1d9e84dad849 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.611912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ca5cb-63f3-40e2-a4da-1d9e84dad849 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:47.612218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ca5cb-63f3-40e2-a4da-1d9e84dad849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.612729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74d9c9-f3ed-4b97-8091-8ec787f531ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.613863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74d9c9-f3ed-4b97-8091-8ec787f531ca None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.613973 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ca5cb-63f3-40e2-a4da-1d9e84dad849 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.614046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74d9c9-f3ed-4b97-8091-8ec787f531ca None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.614046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74d9c9-f3ed-4b97-8091-8ec787f531ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.624349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 58/118] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:47.625482 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ca5cb-63f3-40e2-a4da-1d9e84dad849 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.690113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74d9c9-f3ed-4b97-8091-8ec787f531ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.691617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74d9c9-f3ed-4b97-8091-8ec787f531ca None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.726759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ca5cb-63f3-40e2-a4da-1d9e84dad849 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.762407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735399b-c5f1-4356-8cf4-d167321f28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.763102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735399b-c5f1-4356-8cf4-d167321f28c6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.763382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735399b-c5f1-4356-8cf4-d167321f28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.763647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735399b-c5f1-4356-8cf4-d167321f28c6 None admin] PATH_INFO: `/v3/users/414e4296eeaf4d0ca05d8431eb41135d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.774153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:47.781442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735399b-c5f1-4356-8cf4-d167321f28c6 None admin] RBAC: Authorizing `identity:get_user(user_id=414e4296eeaf4d0ca05d8431eb41135d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.782949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735399b-c5f1-4356-8cf4-d167321f28c6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.784643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 59/119] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/users/414e4296eeaf4d0ca05d8431eb41135d => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:47.785442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735399b-c5f1-4356-8cf4-d167321f28c6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.806331 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 61/120] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:10:47.814758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74d9c9-f3ed-4b97-8091-8ec787f531ca None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.817050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:47.905943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735399b-c5f1-4356-8cf4-d167321f28c6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.919296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74d9c9-f3ed-4b97-8091-8ec787f531ca None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:47.944103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194e26-0ff6-4554-aa45-2883419e55c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.944725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194e26-0ff6-4554-aa45-2883419e55c5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.945012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194e26-0ff6-4554-aa45-2883419e55c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.945407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194e26-0ff6-4554-aa45-2883419e55c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.946165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6194e26-0ff6-4554-aa45-2883419e55c5 None admin] RBAC: Adding query filter params (role.id=72129dcc28d546169fd012284e4019ec, scope.project.id=d297e3933cee44408a03ee5029e09d51, user.id=b819844d641b4956ae9399e9c171524d) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:47.946488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6194e26-0ff6-4554-aa45-2883419e55c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.947976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6194e26-0ff6-4554-aa45-2883419e55c5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.954192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 60/121] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/role_assignments?user.id=b819844d641b4956ae9399e9c171524d&scope.project.id=d297e3933cee44408a03ee5029e09d51&role.id=72129dcc28d546169fd012284e4019ec => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:47.955023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194e26-0ff6-4554-aa45-2883419e55c5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:47.964110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb1223-797c-4cfb-9e09-9d06f5024cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:47.965148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb1223-797c-4cfb-9e09-9d06f5024cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:47.965755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb1223-797c-4cfb-9e09-9d06f5024cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:47.966221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb1223-797c-4cfb-9e09-9d06f5024cc0 None admin] PATH_INFO: `/v3/users/1a8107b76594433a880dd6fc78bcd6d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:47.967865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb1223-797c-4cfb-9e09-9d06f5024cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=1a8107b76594433a880dd6fc78bcd6d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:47.969555 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb1223-797c-4cfb-9e09-9d06f5024cc0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:47.971569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 62/122] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/users/1a8107b76594433a880dd6fc78bcd6d2 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:47.972864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb1223-797c-4cfb-9e09-9d06f5024cc0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:48.045859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:48.063799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:48.102423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb1223-797c-4cfb-9e09-9d06f5024cc0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:48.112173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194e26-0ff6-4554-aa45-2883419e55c5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:48.155825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f170-dfff-4b90-9a6c-4d075ad5e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:48.156527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f170-dfff-4b90-9a6c-4d075ad5e443 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:48.156726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73441cc3-0dc7-4ab4-a0a0-d44722b110b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:48.156835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f170-dfff-4b90-9a6c-4d075ad5e443 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:48.157016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f170-dfff-4b90-9a6c-4d075ad5e443 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:48.157390 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73441cc3-0dc7-4ab4-a0a0-d44722b110b2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:48.157677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73441cc3-0dc7-4ab4-a0a0-d44722b110b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:48.157955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73441cc3-0dc7-4ab4-a0a0-d44722b110b2 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:48.158963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f170-dfff-4b90-9a6c-4d075ad5e443 None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:48.159128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73441cc3-0dc7-4ab4-a0a0-d44722b110b2 None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:48.160410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f170-dfff-4b90-9a6c-4d075ad5e443 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:48.160574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73441cc3-0dc7-4ab4-a0a0-d44722b110b2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:48.162251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 61/123] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:48.162492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 63/124] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:47 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:48.162833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f170-dfff-4b90-9a6c-4d075ad5e443 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:48.168496 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73441cc3-0dc7-4ab4-a0a0-d44722b110b2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:48.282883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73441cc3-0dc7-4ab4-a0a0-d44722b110b2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:48.290112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f170-dfff-4b90-9a6c-4d075ad5e443 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:48.317433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf49d60-922a-4ff4-b6c5-89dc715f2345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:48.318102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf49d60-922a-4ff4-b6c5-89dc715f2345 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:48.318389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf49d60-922a-4ff4-b6c5-89dc715f2345 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:48.318883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf49d60-922a-4ff4-b6c5-89dc715f2345 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51/users/414e4296eeaf4d0ca05d8431eb41135d/roles/8c10cd5042ab49e6a1276dd0450cc2f8` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:48.320113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:48.320698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf49d60-922a-4ff4-b6c5-89dc715f2345 None admin] RBAC: Authorizing `identity:create_grant(project_id=d297e3933cee44408a03ee5029e09d51, user_id=414e4296eeaf4d0ca05d8431eb41135d, role_id=8c10cd5042ab49e6a1276dd0450cc2f8)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:48.322222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf49d60-922a-4ff4-b6c5-89dc715f2345 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:48.327913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2355c-939e-42bf-a4d3-68407f559cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:48.328609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2355c-939e-42bf-a4d3-68407f559cef None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:48.328966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2355c-939e-42bf-a4d3-68407f559cef None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:48.329249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2355c-939e-42bf-a4d3-68407f559cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:48.331252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:48.338837 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 64/125] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:10:48 2022] PUT /identity/v3/projects/d297e3933cee44408a03ee5029e09d51/users/414e4296eeaf4d0ca05d8431eb41135d/roles/8c10cd5042ab49e6a1276dd0450cc2f8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:10:48.339784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf49d60-922a-4ff4-b6c5-89dc715f2345 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:48.445093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2355c-939e-42bf-a4d3-68407f559cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:48.448322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2355c-939e-42bf-a4d3-68407f559cef None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:48.455051 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf49d60-922a-4ff4-b6c5-89dc715f2345 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:48.493159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb9b5-3cb9-4006-b642-db2928837af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:48.493820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb9b5-3cb9-4006-b642-db2928837af1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:48.494104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb9b5-3cb9-4006-b642-db2928837af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:48.494378 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cb9b5-3cb9-4006-b642-db2928837af1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:48.495275 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cb9b5-3cb9-4006-b642-db2928837af1 None admin] RBAC: Adding query filter params (role.id=375d0d25eaa04686ba41303116106916, scope.project.id=d297e3933cee44408a03ee5029e09d51, user.id=1a8107b76594433a880dd6fc78bcd6d2) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:48.495659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cb9b5-3cb9-4006-b642-db2928837af1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:48.497177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cb9b5-3cb9-4006-b642-db2928837af1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:48.512942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 65/126] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:10:48 2022] GET /identity/v3/role_assignments?user.id=1a8107b76594433a880dd6fc78bcd6d2&scope.project.id=d297e3933cee44408a03ee5029e09d51&role.id=375d0d25eaa04686ba41303116106916 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:48.588045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 62/127] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:10:48.593839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb9b5-3cb9-4006-b642-db2928837af1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:48.662790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:48.713186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cb9b5-3cb9-4006-b642-db2928837af1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:48.750685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beb9c4-bd1a-4726-958b-6d7dade9d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:48.751381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beb9c4-bd1a-4726-958b-6d7dade9d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:48.751673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beb9c4-bd1a-4726-958b-6d7dade9d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:48.751952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beb9c4-bd1a-4726-958b-6d7dade9d0a3 None admin] PATH_INFO: `/v3/projects/7900aafc484d4e328c936cf845d5a328` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:48.753111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beb9c4-bd1a-4726-958b-6d7dade9d0a3 None admin] RBAC: Authorizing `identity:get_project(project_id=7900aafc484d4e328c936cf845d5a328)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:48.754663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beb9c4-bd1a-4726-958b-6d7dade9d0a3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:48.756595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 66/128] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:48 2022] GET /identity/v3/projects/7900aafc484d4e328c936cf845d5a328 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:48.763109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2355c-939e-42bf-a4d3-68407f559cef None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:48.792212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:48.872949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2355c-939e-42bf-a4d3-68407f559cef None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:48.911462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2fb8-fd76-44ff-8f09-81fbec19f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:48.912087 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2fb8-fd76-44ff-8f09-81fbec19f86c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:48.912370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2fb8-fd76-44ff-8f09-81fbec19f86c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:48.912643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2fb8-fd76-44ff-8f09-81fbec19f86c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:48.913375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2fb8-fd76-44ff-8f09-81fbec19f86c None admin] RBAC: Adding query filter params (role.id=9145b5c6668a409d854e7d0c4491d775, scope.project.id=7900aafc484d4e328c936cf845d5a328, user.id=1a8107b76594433a880dd6fc78bcd6d2) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:48.913684 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2fb8-fd76-44ff-8f09-81fbec19f86c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:48.915271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2fb8-fd76-44ff-8f09-81fbec19f86c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:48.926809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 63/129] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:10:48 2022] GET /identity/v3/role_assignments?user.id=1a8107b76594433a880dd6fc78bcd6d2&scope.project.id=7900aafc484d4e328c936cf845d5a328&role.id=9145b5c6668a409d854e7d0c4491d775 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:49.297248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b7841-d77b-4867-b973-cab3f5f38a79 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:49.297495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b7841-d77b-4867-b973-cab3f5f38a79 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:49.297785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b7841-d77b-4867-b973-cab3f5f38a79 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:49.299199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 67/130] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:49.304801 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e0b1b-0caa-46bd-9379-4be71448b165 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:49.305089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e0b1b-0caa-46bd-9379-4be71448b165 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:49.305363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e0b1b-0caa-46bd-9379-4be71448b165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:49.324449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-530e0b1b-0caa-46bd-9379-4be71448b165 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:49.325630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-530e0b1b-0caa-46bd-9379-4be71448b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:49.395279 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 64/131] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:49.662248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b7841-d77b-4867-b973-cab3f5f38a79 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:49.772897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b7841-d77b-4867-b973-cab3f5f38a79 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:49.803746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:49.810170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bcca7-fb51-4642-ba55-31b047210d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:49.810832 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bcca7-fb51-4642-ba55-31b047210d11 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:49.811103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bcca7-fb51-4642-ba55-31b047210d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:49.811384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bcca7-fb51-4642-ba55-31b047210d11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:49.812467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bcca7-fb51-4642-ba55-31b047210d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:49.813900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bcca7-fb51-4642-ba55-31b047210d11 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:49.815497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 68/132] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:49.821329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e0b1b-0caa-46bd-9379-4be71448b165 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:49.847224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:49.922685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e0b1b-0caa-46bd-9379-4be71448b165 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:49.955853 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708c0c2-fab6-46ff-9e32-4fbc57050937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:49.956467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708c0c2-fab6-46ff-9e32-4fbc57050937 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:49.956751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708c0c2-fab6-46ff-9e32-4fbc57050937 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:49.957021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708c0c2-fab6-46ff-9e32-4fbc57050937 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:49.957681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708c0c2-fab6-46ff-9e32-4fbc57050937 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:49.959161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708c0c2-fab6-46ff-9e32-4fbc57050937 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:49.982237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 65/133] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:10:49 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:50.548480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d3d70-a016-4c14-8ceb-1b6489597522 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:50.548887 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d3d70-a016-4c14-8ceb-1b6489597522 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:50.549057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d3d70-a016-4c14-8ceb-1b6489597522 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:50.550405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 69/134] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:50.555948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b64be-5044-4c3e-8e7a-848789300928 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:50.556236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b64be-5044-4c3e-8e7a-848789300928 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:50.556513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b64be-5044-4c3e-8e7a-848789300928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:50.574876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-003b64be-5044-4c3e-8e7a-848789300928 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:50.576063 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-003b64be-5044-4c3e-8e7a-848789300928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:50.646851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 66/135] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:50.910947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d3d70-a016-4c14-8ceb-1b6489597522 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:51.015070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d3d70-a016-4c14-8ceb-1b6489597522 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:51.047524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4098d45-37c4-429b-99d4-ee0d76ff85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:51.048166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4098d45-37c4-429b-99d4-ee0d76ff85a5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:51.048457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4098d45-37c4-429b-99d4-ee0d76ff85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:51.048720 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4098d45-37c4-429b-99d4-ee0d76ff85a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:51.059367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4098d45-37c4-429b-99d4-ee0d76ff85a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-f4098d45-37c4-429b-99d4-ee0d76ff85a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:51.064253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:51.065113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:51.065932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 70/136] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:51.073264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b64be-5044-4c3e-8e7a-848789300928 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:51.087294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:51.185781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b64be-5044-4c3e-8e7a-848789300928 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:51.220211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08213a-5402-4657-94c9-48e4b8c454fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:51.221098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08213a-5402-4657-94c9-48e4b8c454fc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:51.221554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08213a-5402-4657-94c9-48e4b8c454fc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:51.222010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08213a-5402-4657-94c9-48e4b8c454fc None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:51.222884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08213a-5402-4657-94c9-48e4b8c454fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:51.223366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08213a-5402-4657-94c9-48e4b8c454fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:51.224900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08213a-5402-4657-94c9-48e4b8c454fc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:51.233695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 67/137] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:10:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:51.239403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4098d45-37c4-429b-99d4-ee0d76ff85a5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:51.308820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:51.340762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4098d45-37c4-429b-99d4-ee0d76ff85a5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:51.374421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b665148-77bf-42a1-8ee3-6642aa0188d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:51.375148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b665148-77bf-42a1-8ee3-6642aa0188d8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:51.375429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b665148-77bf-42a1-8ee3-6642aa0188d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:51.375717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b665148-77bf-42a1-8ee3-6642aa0188d8 None admin] PATH_INFO: `/v3/users/414e4296eeaf4d0ca05d8431eb41135d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:51.376883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b665148-77bf-42a1-8ee3-6642aa0188d8 None admin] RBAC: Authorizing `identity:get_user(user_id=414e4296eeaf4d0ca05d8431eb41135d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:51.378333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b665148-77bf-42a1-8ee3-6642aa0188d8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:51.379952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 71/138] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:51 2022] GET /identity/v3/users/414e4296eeaf4d0ca05d8431eb41135d => generated 289 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:51.385819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08213a-5402-4657-94c9-48e4b8c454fc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:51.456943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:51.492098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08213a-5402-4657-94c9-48e4b8c454fc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:51.526930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333e8ed-ae2e-4862-85c9-58d3a60e2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:51.527553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333e8ed-ae2e-4862-85c9-58d3a60e2b69 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:51.527833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333e8ed-ae2e-4862-85c9-58d3a60e2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:51.528103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333e8ed-ae2e-4862-85c9-58d3a60e2b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:51.599034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333e8ed-ae2e-4862-85c9-58d3a60e2b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:51.600524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333e8ed-ae2e-4862-85c9-58d3a60e2b69 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:51.669514 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:51.701120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 68/139] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:10:51.708110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b665148-77bf-42a1-8ee3-6642aa0188d8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:51.811553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b665148-77bf-42a1-8ee3-6642aa0188d8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:51.838399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:51.850401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3776b04-bf77-47fd-8266-dac935281e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:51.851087 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3776b04-bf77-47fd-8266-dac935281e3d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:51.851373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3776b04-bf77-47fd-8266-dac935281e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:51.851680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3776b04-bf77-47fd-8266-dac935281e3d None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:51.852822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3776b04-bf77-47fd-8266-dac935281e3d None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:51.854276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3776b04-bf77-47fd-8266-dac935281e3d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:51.856283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 72/140] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:51 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:51.862075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333e8ed-ae2e-4862-85c9-58d3a60e2b69 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:51.964044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333e8ed-ae2e-4862-85c9-58d3a60e2b69 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:51.998297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845b46b-fe5e-4c25-9965-70e97795efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:51.998998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845b46b-fe5e-4c25-9965-70e97795efd9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:51.999280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845b46b-fe5e-4c25-9965-70e97795efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:51.999553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845b46b-fe5e-4c25-9965-70e97795efd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.000296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845b46b-fe5e-4c25-9965-70e97795efd9 None admin] RBAC: Adding query filter params (role.id=8c10cd5042ab49e6a1276dd0450cc2f8, scope.project.id=d297e3933cee44408a03ee5029e09d51, user.id=414e4296eeaf4d0ca05d8431eb41135d) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:52.000611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845b46b-fe5e-4c25-9965-70e97795efd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:52.002100 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845b46b-fe5e-4c25-9965-70e97795efd9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:52.008706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 69/141] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:10:51 2022] GET /identity/v3/role_assignments?user.id=414e4296eeaf4d0ca05d8431eb41135d&scope.project.id=d297e3933cee44408a03ee5029e09d51&role.id=8c10cd5042ab49e6a1276dd0450cc2f8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:52.297267 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3da16-a2bc-409b-852e-a6a9c1658bf8 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:52.297780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3da16-a2bc-409b-852e-a6a9c1658bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:52.297780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3da16-a2bc-409b-852e-a6a9c1658bf8 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.299130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 73/142] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:52.304274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6391ba1-e253-4daf-aa4b-ef19618b99f5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:52.304713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6391ba1-e253-4daf-aa4b-ef19618b99f5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:52.304853 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6391ba1-e253-4daf-aa4b-ef19618b99f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.324810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b6391ba1-e253-4daf-aa4b-ef19618b99f5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:52.326049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b6391ba1-e253-4daf-aa4b-ef19618b99f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:52.357252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:52.403623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 70/143] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:10:52.445265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9921-f70a-4dbc-af2d-01f803b6523c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:52.445559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9921-f70a-4dbc-af2d-01f803b6523c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:52.445861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc9921-f70a-4dbc-af2d-01f803b6523c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.447423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 74/144] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:52.452622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0888c0-0e0d-4165-974e-f31f914f5d28 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:52.452933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0888c0-0e0d-4165-974e-f31f914f5d28 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:52.453186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0888c0-0e0d-4165-974e-f31f914f5d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.472692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1b0888c0-0e0d-4165-974e-f31f914f5d28 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:52.473945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1b0888c0-0e0d-4165-974e-f31f914f5d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:52.483384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216e92f-f7a3-4528-8d52-47ed28b9e7de None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:52.483667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216e92f-f7a3-4528-8d52-47ed28b9e7de None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:52.483954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216e92f-f7a3-4528-8d52-47ed28b9e7de None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.485433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 75/145] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:10:52.490424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdb67-2d05-4813-9c11-134f81564d99 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:52.490755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdb67-2d05-4813-9c11-134f81564d99 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:52.491012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cdb67-2d05-4813-9c11-134f81564d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.508803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e30cdb67-2d05-4813-9c11-134f81564d99 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:52.509986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e30cdb67-2d05-4813-9c11-134f81564d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:52.544301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 71/146] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:52.579684 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 76/147] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:10:52.665435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0888c0-0e0d-4165-974e-f31f914f5d28 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:52.758920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:52.767013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0888c0-0e0d-4165-974e-f31f914f5d28 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:52.803099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a02fe3-dfe2-4fcd-a4a0-bf906f7b08f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:52.803742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a02fe3-dfe2-4fcd-a4a0-bf906f7b08f8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:52.804024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a02fe3-dfe2-4fcd-a4a0-bf906f7b08f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:52.804286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a02fe3-dfe2-4fcd-a4a0-bf906f7b08f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.805545 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cdb67-2d05-4813-9c11-134f81564d99 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:52.815585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a02fe3-dfe2-4fcd-a4a0-bf906f7b08f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-12a02fe3-dfe2-4fcd-a4a0-bf906f7b08f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:52.820658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:52.821526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:52.822296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 72/148] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:52.827475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a02fe3-dfe2-4fcd-a4a0-bf906f7b08f8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:52.909019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cdb67-2d05-4813-9c11-134f81564d99 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:52.932159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:52.937030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a02fe3-dfe2-4fcd-a4a0-bf906f7b08f8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:52.943452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02574b-04e9-4aa2-8923-eea41f9069bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:52.944089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02574b-04e9-4aa2-8923-eea41f9069bb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:52.944387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02574b-04e9-4aa2-8923-eea41f9069bb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:52.944651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02574b-04e9-4aa2-8923-eea41f9069bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.955354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02574b-04e9-4aa2-8923-eea41f9069bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-5e02574b-04e9-4aa2-8923-eea41f9069bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:52.960160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:52.961120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:52.962071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 77/149] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:10:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:52.962846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02574b-04e9-4aa2-8923-eea41f9069bb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:52.973320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ea62f-e525-4454-aa30-27b8b676ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:52.973940 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ea62f-e525-4454-aa30-27b8b676ed5e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:52.974219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ea62f-e525-4454-aa30-27b8b676ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:52.974490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ea62f-e525-4454-aa30-27b8b676ed5e None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:52.975198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ea62f-e525-4454-aa30-27b8b676ed5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:52.975500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ea62f-e525-4454-aa30-27b8b676ed5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:52.977025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ea62f-e525-4454-aa30-27b8b676ed5e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:52.985373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 73/150] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:10:52.986147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ea62f-e525-4454-aa30-27b8b676ed5e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:53.005212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:53.060556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02574b-04e9-4aa2-8923-eea41f9069bb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:53.086925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ea62f-e525-4454-aa30-27b8b676ed5e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:53.094356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f9c84-0272-4396-9cb4-24baad5f5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:53.094969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f9c84-0272-4396-9cb4-24baad5f5aae None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:53.095246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f9c84-0272-4396-9cb4-24baad5f5aae None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:53.095514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f9c84-0272-4396-9cb4-24baad5f5aae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:53.096631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f9c84-0272-4396-9cb4-24baad5f5aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:53.098141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f9c84-0272-4396-9cb4-24baad5f5aae None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:53.099923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 78/151] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:53.100595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f9c84-0272-4396-9cb4-24baad5f5aae None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:53.124029 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750eea-ae10-4dbd-aceb-a74c3fc40586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:53.124684 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750eea-ae10-4dbd-aceb-a74c3fc40586 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:53.124960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750eea-ae10-4dbd-aceb-a74c3fc40586 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:53.125228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750eea-ae10-4dbd-aceb-a74c3fc40586 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:53.125891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5750eea-ae10-4dbd-aceb-a74c3fc40586 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:53.126197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5750eea-ae10-4dbd-aceb-a74c3fc40586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:53.127605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5750eea-ae10-4dbd-aceb-a74c3fc40586 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:53.135568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 74/152] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:10:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:53.139614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750eea-ae10-4dbd-aceb-a74c3fc40586 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:53.154560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:53.201164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f9c84-0272-4396-9cb4-24baad5f5aae None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:53.217646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:53.235279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399964bc-1480-4486-97f0-5301acc01573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:53.235947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399964bc-1480-4486-97f0-5301acc01573 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:53.236230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399964bc-1480-4486-97f0-5301acc01573 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:53.236511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399964bc-1480-4486-97f0-5301acc01573 None admin] PATH_INFO: `/v3/users/bd4427b6cfae419eb1fd77ff2a357936` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:53.239805 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750eea-ae10-4dbd-aceb-a74c3fc40586 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:53.249640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399964bc-1480-4486-97f0-5301acc01573 None admin] RBAC: Authorizing `identity:get_user(user_id=bd4427b6cfae419eb1fd77ff2a357936)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:53.251136 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399964bc-1480-4486-97f0-5301acc01573 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:53.253020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 79/153] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:53 2022] GET /identity/v3/users/bd4427b6cfae419eb1fd77ff2a357936 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:53.253557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399964bc-1480-4486-97f0-5301acc01573 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:53.273977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a683e2-b5f5-4148-984d-162104225cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:53.274588 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a683e2-b5f5-4148-984d-162104225cae None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:53.274887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a683e2-b5f5-4148-984d-162104225cae None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:53.275164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a683e2-b5f5-4148-984d-162104225cae None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:53.276732 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a683e2-b5f5-4148-984d-162104225cae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:53.279037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a683e2-b5f5-4148-984d-162104225cae None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:53.299724 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 75/154] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:10:53 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:10:53.300548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a683e2-b5f5-4148-984d-162104225cae None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:53.363875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399964bc-1480-4486-97f0-5301acc01573 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:53.377353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:53.405076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67932e59-3e19-4b0e-be43-751ffc27a6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:53.405937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67932e59-3e19-4b0e-be43-751ffc27a6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:53.406215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67932e59-3e19-4b0e-be43-751ffc27a6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:53.406485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67932e59-3e19-4b0e-be43-751ffc27a6e5 None admin] PATH_INFO: `/v3/users/bd4427b6cfae419eb1fd77ff2a357936` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:53.407716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67932e59-3e19-4b0e-be43-751ffc27a6e5 None admin] RBAC: Authorizing `identity:get_user(user_id=bd4427b6cfae419eb1fd77ff2a357936)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:53.409203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67932e59-3e19-4b0e-be43-751ffc27a6e5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:53.411106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 80/155] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:53 2022] GET /identity/v3/users/bd4427b6cfae419eb1fd77ff2a357936 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:53.416632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67932e59-3e19-4b0e-be43-751ffc27a6e5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:53.421976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a683e2-b5f5-4148-984d-162104225cae None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:53.459812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162be7-b864-4e54-963c-db70b9746253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:53.460860 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162be7-b864-4e54-963c-db70b9746253 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:53.461208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162be7-b864-4e54-963c-db70b9746253 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:53.461810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56162be7-b864-4e54-963c-db70b9746253 None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:53.463083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56162be7-b864-4e54-963c-db70b9746253 None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:53.464564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56162be7-b864-4e54-963c-db70b9746253 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:53.466442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 76/156] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:53 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:53.472230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162be7-b864-4e54-963c-db70b9746253 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:53.476309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:53.530549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67932e59-3e19-4b0e-be43-751ffc27a6e5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:53.570697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815241b1-030e-4690-ba95-999259d0f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:53.571752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815241b1-030e-4690-ba95-999259d0f015 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:53.572037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815241b1-030e-4690-ba95-999259d0f015 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:53.572309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815241b1-030e-4690-ba95-999259d0f015 None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:53.573775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815241b1-030e-4690-ba95-999259d0f015 None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:53.575578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815241b1-030e-4690-ba95-999259d0f015 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:53.577430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 81/157] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:53 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:10:53.583660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815241b1-030e-4690-ba95-999259d0f015 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:53.601868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56162be7-b864-4e54-963c-db70b9746253 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:53.636086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:53.648670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c04297-ab41-4c8b-a83c-5d7d16f3f100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:53.649094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c04297-ab41-4c8b-a83c-5d7d16f3f100 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:53.649928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c04297-ab41-4c8b-a83c-5d7d16f3f100 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:53.649928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c04297-ab41-4c8b-a83c-5d7d16f3f100 None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3/users/bd4427b6cfae419eb1fd77ff2a357936/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:53.651907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c04297-ab41-4c8b-a83c-5d7d16f3f100 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f6bde32c8f64180821a289d7647aab3, user_id=bd4427b6cfae419eb1fd77ff2a357936, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:53.653755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c04297-ab41-4c8b-a83c-5d7d16f3f100 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:53.669773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 77/158] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:10:53 2022] PUT /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3/users/bd4427b6cfae419eb1fd77ff2a357936/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:10:53.704209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815241b1-030e-4690-ba95-999259d0f015 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:53.745312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557856a-d280-4531-83f1-2d5968e8febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:53.746396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557856a-d280-4531-83f1-2d5968e8febc None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:53.746889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557856a-d280-4531-83f1-2d5968e8febc None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:53.747340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557856a-d280-4531-83f1-2d5968e8febc None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3/users/bd4427b6cfae419eb1fd77ff2a357936/roles/375d0d25eaa04686ba41303116106916` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:53.749896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557856a-d280-4531-83f1-2d5968e8febc None admin] RBAC: Authorizing `identity:create_grant(project_id=8f6bde32c8f64180821a289d7647aab3, user_id=bd4427b6cfae419eb1fd77ff2a357936, role_id=375d0d25eaa04686ba41303116106916)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:53.751708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557856a-d280-4531-83f1-2d5968e8febc None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:53.768072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 82/159] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:10:53 2022] PUT /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3/users/bd4427b6cfae419eb1fd77ff2a357936/roles/375d0d25eaa04686ba41303116106916 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:10:55.612073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629fd93-856e-4e80-bd21-54f5d1156d4e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:55.612599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629fd93-856e-4e80-bd21-54f5d1156d4e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:55.612599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629fd93-856e-4e80-bd21-54f5d1156d4e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:55.613996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 78/160] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:55.619580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae544f51-edd4-4aa2-a9d3-dec72211151a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:55.619987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae544f51-edd4-4aa2-a9d3-dec72211151a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:55.620158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae544f51-edd4-4aa2-a9d3-dec72211151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:55.639034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ae544f51-edd4-4aa2-a9d3-dec72211151a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:55.640241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ae544f51-edd4-4aa2-a9d3-dec72211151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:55.717335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 83/161] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:55.780976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a713a6-a6b8-4986-acac-4b05fbc9cca2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:55.781284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a713a6-a6b8-4986-acac-4b05fbc9cca2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:55.781538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a713a6-a6b8-4986-acac-4b05fbc9cca2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:55.783170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 79/162] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:55.788650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689026-62b0-4372-9982-578e4c2dc016 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:55.789189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689026-62b0-4372-9982-578e4c2dc016 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:55.789651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689026-62b0-4372-9982-578e4c2dc016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:55.808529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a6689026-62b0-4372-9982-578e4c2dc016 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:55.810064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a6689026-62b0-4372-9982-578e4c2dc016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:55.844362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:55.890884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 84/163] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:55.972363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0964e-19e8-44a0-8337-37d19c59aa7d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:55.973000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0964e-19e8-44a0-8337-37d19c59aa7d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:55.973469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0964e-19e8-44a0-8337-37d19c59aa7d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:55.975374 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 80/164] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:55.980994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9951-2358-43ac-af45-207db7a8a96e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:55.981530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9951-2358-43ac-af45-207db7a8a96e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:55.982017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9951-2358-43ac-af45-207db7a8a96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:55.992695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0964e-19e8-44a0-8337-37d19c59aa7d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.003076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a7bd9951-2358-43ac-af45-207db7a8a96e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:56.004911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a7bd9951-2358-43ac-af45-207db7a8a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:56.064523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:56.090588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 85/165] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:56.090588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f385a2-a496-43b3-9773-3178f9aabb1b None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.090588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f385a2-a496-43b3-9773-3178f9aabb1b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.090588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f385a2-a496-43b3-9773-3178f9aabb1b None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.090588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 86/166] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:56.092122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069f633-bf7b-427f-8165-1c0447cd62a9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.092499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069f633-bf7b-427f-8165-1c0447cd62a9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.092781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069f633-bf7b-427f-8165-1c0447cd62a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.111642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8069f633-bf7b-427f-8165-1c0447cd62a9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:56.113513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8069f633-bf7b-427f-8165-1c0447cd62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:56.115789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0964e-19e8-44a0-8337-37d19c59aa7d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:56.152645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac10875-a697-4b69-b0d0-4639fd6d7664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:56.152645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10875-a697-4b69-b0d0-4639fd6d7664 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.152925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10875-a697-4b69-b0d0-4639fd6d7664 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.153299 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10875-a697-4b69-b0d0-4639fd6d7664 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.165136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac10875-a697-4b69-b0d0-4639fd6d7664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0ac10875-a697-4b69-b0d0-4639fd6d7664 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:56.170800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:56.171748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 81/167] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:56.177280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac10875-a697-4b69-b0d0-4639fd6d7664 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.190918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 87/168] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:10:56.197866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069f633-bf7b-427f-8165-1c0447cd62a9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.227725 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:56.293585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac10875-a697-4b69-b0d0-4639fd6d7664 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:56.311364 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069f633-bf7b-427f-8165-1c0447cd62a9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:56.316492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:56.328533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4eefc-2348-4b56-8c19-0186267cb9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:56.329262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4eefc-2348-4b56-8c19-0186267cb9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.329608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4eefc-2348-4b56-8c19-0186267cb9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.330191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4eefc-2348-4b56-8c19-0186267cb9d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.331637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4eefc-2348-4b56-8c19-0186267cb9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:56.334170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4eefc-2348-4b56-8c19-0186267cb9d5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:56.336038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 82/169] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:56.341726 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4eefc-2348-4b56-8c19-0186267cb9d5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.349144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d79780-cccc-48ec-a162-913f5de8ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:56.349771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79780-cccc-48ec-a162-913f5de8ae14 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.350051 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79780-cccc-48ec-a162-913f5de8ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.350323 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79780-cccc-48ec-a162-913f5de8ae14 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.351450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d79780-cccc-48ec-a162-913f5de8ae14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:56.351795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d79780-cccc-48ec-a162-913f5de8ae14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:56.353545 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d79780-cccc-48ec-a162-913f5de8ae14 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:56.364040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 88/170] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:10:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:56.369746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d79780-cccc-48ec-a162-913f5de8ae14 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.448673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4eefc-2348-4b56-8c19-0186267cb9d5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:56.459114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:56.472837 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d79780-cccc-48ec-a162-913f5de8ae14 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:56.483146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc843cf-244a-4693-83f1-8e2e0de5a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:56.483751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc843cf-244a-4693-83f1-8e2e0de5a10a None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.484028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc843cf-244a-4693-83f1-8e2e0de5a10a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.484308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc843cf-244a-4693-83f1-8e2e0de5a10a None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.484974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc843cf-244a-4693-83f1-8e2e0de5a10a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:56.486410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc843cf-244a-4693-83f1-8e2e0de5a10a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:56.506904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 83/171] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:10:56 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:10:56.507901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc843cf-244a-4693-83f1-8e2e0de5a10a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.510952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25969b84-c1a8-4425-abf8-39f819037190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:56.511618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25969b84-c1a8-4425-abf8-39f819037190 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.512262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25969b84-c1a8-4425-abf8-39f819037190 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.512532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25969b84-c1a8-4425-abf8-39f819037190 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.524966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25969b84-c1a8-4425-abf8-39f819037190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-25969b84-c1a8-4425-abf8-39f819037190 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:56.530604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:56.531822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 89/172] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:10:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:10:56.532811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25969b84-c1a8-4425-abf8-39f819037190 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.587073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:56.648858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25969b84-c1a8-4425-abf8-39f819037190 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:56.652498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc843cf-244a-4693-83f1-8e2e0de5a10a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:56.685884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6cfa-9bcd-4fb2-8c51-bbc9f5e24f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:56.686817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6cfa-9bcd-4fb2-8c51-bbc9f5e24f0b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.687278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6cfa-9bcd-4fb2-8c51-bbc9f5e24f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.687718 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6cfa-9bcd-4fb2-8c51-bbc9f5e24f0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.693328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1000c3-5293-4473-b06a-3a21f9035bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:56.693984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1000c3-5293-4473-b06a-3a21f9035bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.694266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1000c3-5293-4473-b06a-3a21f9035bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.694541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1000c3-5293-4473-b06a-3a21f9035bc3 None admin] PATH_INFO: `/v3/users/5f01b4b877f042b6ab0fb5119518a306` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.700403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d6cfa-9bcd-4fb2-8c51-bbc9f5e24f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-d49d6cfa-9bcd-4fb2-8c51-bbc9f5e24f0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:56.705373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:56.706359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:10:56.707177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:10:56.707753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 90/173] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:56.708905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6cfa-9bcd-4fb2-8c51-bbc9f5e24f0b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.710107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1000c3-5293-4473-b06a-3a21f9035bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=5f01b4b877f042b6ab0fb5119518a306)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:56.711816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1000c3-5293-4473-b06a-3a21f9035bc3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:56.713620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 84/174] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:56 2022] GET /identity/v3/users/5f01b4b877f042b6ab0fb5119518a306 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:56.714691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1000c3-5293-4473-b06a-3a21f9035bc3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.721201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:56.822572 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6cfa-9bcd-4fb2-8c51-bbc9f5e24f0b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:56.835124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1000c3-5293-4473-b06a-3a21f9035bc3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:56.841986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:56.871623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fe0f0-a2b0-4dae-b105-d734658f4e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:56.872503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fe0f0-a2b0-4dae-b105-d734658f4e85 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.872951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fe0f0-a2b0-4dae-b105-d734658f4e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.873229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fe0f0-a2b0-4dae-b105-d734658f4e85 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.873958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fe0f0-a2b0-4dae-b105-d734658f4e85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:56.874193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fe0f0-a2b0-4dae-b105-d734658f4e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:56.875635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fe0f0-a2b0-4dae-b105-d734658f4e85 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:56.882143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87db08-a7d1-4fc3-8781-53718e4c0226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:56.882448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87db08-a7d1-4fc3-8781-53718e4c0226 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:56.882747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87db08-a7d1-4fc3-8781-53718e4c0226 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:56.883110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87db08-a7d1-4fc3-8781-53718e4c0226 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:56.883791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87db08-a7d1-4fc3-8781-53718e4c0226 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:56.884107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87db08-a7d1-4fc3-8781-53718e4c0226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:56.885469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87db08-a7d1-4fc3-8781-53718e4c0226 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:56.886558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 91/175] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:10:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:56.887877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fe0f0-a2b0-4dae-b105-d734658f4e85 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.901191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 85/176] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:56.901768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87db08-a7d1-4fc3-8781-53718e4c0226 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:56.983645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:57.017790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fe0f0-a2b0-4dae-b105-d734658f4e85 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:57.048003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87db08-a7d1-4fc3-8781-53718e4c0226 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:57.052545 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e314-36c4-4172-810a-33455e539ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:57.053298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e314-36c4-4172-810a-33455e539ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:57.053670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e314-36c4-4172-810a-33455e539ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:57.054032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e314-36c4-4172-810a-33455e539ea6 None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:57.055320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814e314-36c4-4172-810a-33455e539ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:57.056846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814e314-36c4-4172-810a-33455e539ea6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:57.058977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 92/177] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:56 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:57.060030 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e314-36c4-4172-810a-33455e539ea6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:57.087858 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fcb33-5143-48ad-8ee9-5e7c6aaea8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:57.088504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fcb33-5143-48ad-8ee9-5e7c6aaea8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:57.088783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fcb33-5143-48ad-8ee9-5e7c6aaea8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:57.089099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fcb33-5143-48ad-8ee9-5e7c6aaea8b5 None admin] PATH_INFO: `/v3/users/bd4427b6cfae419eb1fd77ff2a357936` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:57.091042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fcb33-5143-48ad-8ee9-5e7c6aaea8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=bd4427b6cfae419eb1fd77ff2a357936)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:57.093657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fcb33-5143-48ad-8ee9-5e7c6aaea8b5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:57.096585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 86/178] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:56 2022] GET /identity/v3/users/bd4427b6cfae419eb1fd77ff2a357936 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:57.099292 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fcb33-5143-48ad-8ee9-5e7c6aaea8b5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:57.141822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:57.187108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e314-36c4-4172-810a-33455e539ea6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:57.226251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4171c-6a0a-4b7d-88a4-7e69de9b9fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:57.227004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fcb33-5143-48ad-8ee9-5e7c6aaea8b5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:57.227115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4171c-6a0a-4b7d-88a4-7e69de9b9fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:57.227306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4171c-6a0a-4b7d-88a4-7e69de9b9fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:57.227587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4171c-6a0a-4b7d-88a4-7e69de9b9fa4 None admin] PATH_INFO: `/v3/users/bd4427b6cfae419eb1fd77ff2a357936` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:57.228738 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4171c-6a0a-4b7d-88a4-7e69de9b9fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=bd4427b6cfae419eb1fd77ff2a357936)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:57.230201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4171c-6a0a-4b7d-88a4-7e69de9b9fa4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:57.232137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 93/179] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:57 2022] GET /identity/v3/users/bd4427b6cfae419eb1fd77ff2a357936 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:57.232968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4171c-6a0a-4b7d-88a4-7e69de9b9fa4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:57.242649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:57.273668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1d7b3-f981-44bc-af29-81de47a96492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:57.274367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1d7b3-f981-44bc-af29-81de47a96492 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:57.274650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1d7b3-f981-44bc-af29-81de47a96492 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:57.274948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1d7b3-f981-44bc-af29-81de47a96492 None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3/users/5f01b4b877f042b6ab0fb5119518a306/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:57.276894 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1d7b3-f981-44bc-af29-81de47a96492 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f6bde32c8f64180821a289d7647aab3, user_id=5f01b4b877f042b6ab0fb5119518a306, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:57.278379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1d7b3-f981-44bc-af29-81de47a96492 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:57.297969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 87/180] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:10:57 2022] PUT /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3/users/5f01b4b877f042b6ab0fb5119518a306/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:10:57.299052 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1d7b3-f981-44bc-af29-81de47a96492 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:57.355623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4171c-6a0a-4b7d-88a4-7e69de9b9fa4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:57.424685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21e9bb-a023-4c50-9989-b05dc9dfa4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:57.425329 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21e9bb-a023-4c50-9989-b05dc9dfa4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:57.425609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21e9bb-a023-4c50-9989-b05dc9dfa4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:57.425878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21e9bb-a023-4c50-9989-b05dc9dfa4b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:57.484511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:57.497573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1d7b3-f981-44bc-af29-81de47a96492 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:57.546583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81045f16-0c1a-4dc9-bb61-4d91d216fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:57.547256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81045f16-0c1a-4dc9-bb61-4d91d216fd51 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:57.547534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81045f16-0c1a-4dc9-bb61-4d91d216fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:57.547809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81045f16-0c1a-4dc9-bb61-4d91d216fd51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:57.553817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21e9bb-a023-4c50-9989-b05dc9dfa4b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:57.555368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21e9bb-a023-4c50-9989-b05dc9dfa4b1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:57.565825 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:57.658212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81045f16-0c1a-4dc9-bb61-4d91d216fd51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:57.660340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81045f16-0c1a-4dc9-bb61-4d91d216fd51 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:57.681162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 94/181] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:10:57.687126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21e9bb-a023-4c50-9989-b05dc9dfa4b1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:57.801509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21e9bb-a023-4c50-9989-b05dc9dfa4b1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:57.813279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:57.850143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab845-e777-4e4b-a99a-2188ff2cb2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:57.850826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab845-e777-4e4b-a99a-2188ff2cb2dd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:57.854037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab845-e777-4e4b-a99a-2188ff2cb2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:57.854332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab845-e777-4e4b-a99a-2188ff2cb2dd None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:57.855762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ab845-e777-4e4b-a99a-2188ff2cb2dd None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:57.857229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ab845-e777-4e4b-a99a-2188ff2cb2dd None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:57.858926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 95/182] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:57 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:57.863687 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:57.864768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab845-e777-4e4b-a99a-2188ff2cb2dd None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:57.881638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 88/183] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:10:57.887470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81045f16-0c1a-4dc9-bb61-4d91d216fd51 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:57.984636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab845-e777-4e4b-a99a-2188ff2cb2dd None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:58.036413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6beb0-2d23-4095-8fae-dba38fbe3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:58.038160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6beb0-2d23-4095-8fae-dba38fbe3517 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:58.039253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6beb0-2d23-4095-8fae-dba38fbe3517 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:58.039749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6beb0-2d23-4095-8fae-dba38fbe3517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:58.040848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6beb0-2d23-4095-8fae-dba38fbe3517 None admin] RBAC: Adding query filter params (role.id=375d0d25eaa04686ba41303116106916, scope.project.id=8f6bde32c8f64180821a289d7647aab3, user.id=bd4427b6cfae419eb1fd77ff2a357936) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:58.043101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6beb0-2d23-4095-8fae-dba38fbe3517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:58.044769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6beb0-2d23-4095-8fae-dba38fbe3517 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:58.045161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81045f16-0c1a-4dc9-bb61-4d91d216fd51 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:58.058280 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 96/184] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:10:57 2022] GET /identity/v3/role_assignments?user.id=bd4427b6cfae419eb1fd77ff2a357936&scope.project.id=8f6bde32c8f64180821a289d7647aab3&role.id=375d0d25eaa04686ba41303116106916 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:58.106537 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89e914-6e21-48cb-b401-de62c1744421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:58.107242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89e914-6e21-48cb-b401-de62c1744421 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:58.107523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89e914-6e21-48cb-b401-de62c1744421 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:58.107800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89e914-6e21-48cb-b401-de62c1744421 None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:58.111542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89e914-6e21-48cb-b401-de62c1744421 None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:58.113077 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89e914-6e21-48cb-b401-de62c1744421 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:58.115095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 89/185] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:57 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:10:58.121023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6beb0-2d23-4095-8fae-dba38fbe3517 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:58.175571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:58.251061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6beb0-2d23-4095-8fae-dba38fbe3517 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:58.288762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378061ba-1893-43e1-a270-5f2c3da14e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:58.289785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378061ba-1893-43e1-a270-5f2c3da14e79 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:58.290281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378061ba-1893-43e1-a270-5f2c3da14e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:58.290774 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378061ba-1893-43e1-a270-5f2c3da14e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:58.291709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378061ba-1893-43e1-a270-5f2c3da14e79 None admin] RBAC: Adding query filter params (role.id=72129dcc28d546169fd012284e4019ec, scope.project.id=8f6bde32c8f64180821a289d7647aab3, user.id=bd4427b6cfae419eb1fd77ff2a357936) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:58.292236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378061ba-1893-43e1-a270-5f2c3da14e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:58.293902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378061ba-1893-43e1-a270-5f2c3da14e79 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:58.300314 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 97/186] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:10:58 2022] GET /identity/v3/role_assignments?user.id=bd4427b6cfae419eb1fd77ff2a357936&scope.project.id=8f6bde32c8f64180821a289d7647aab3&role.id=72129dcc28d546169fd012284e4019ec => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:58.970064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50066ef-f065-4f02-887b-1e7cf54b652f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:58.970638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50066ef-f065-4f02-887b-1e7cf54b652f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:58.970638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50066ef-f065-4f02-887b-1e7cf54b652f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:58.972133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 90/187] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:58.977248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c319a7-1386-4c89-8328-965dec1fffee None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:58.977665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c319a7-1386-4c89-8328-965dec1fffee None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:58.977928 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c319a7-1386-4c89-8328-965dec1fffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:58.996551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-67c319a7-1386-4c89-8328-965dec1fffee None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:58.997737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-67c319a7-1386-4c89-8328-965dec1fffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:59.073588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 98/188] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:59.141339 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3c728-54d1-46b8-ab7c-d2c26560bbd1 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:59.141537 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3c728-54d1-46b8-ab7c-d2c26560bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:59.141768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3c728-54d1-46b8-ab7c-d2c26560bbd1 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:59.143356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 91/189] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:59.148605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef42da-1e92-4614-b391-582b51bae199 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:59.148898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef42da-1e92-4614-b391-582b51bae199 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:59.149173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef42da-1e92-4614-b391-582b51bae199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:59.167969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f5ef42da-1e92-4614-b391-582b51bae199 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:59.169153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f5ef42da-1e92-4614-b391-582b51bae199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:59.195911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:59.240282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 99/190] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:10:59.339955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3c728-54d1-46b8-ab7c-d2c26560bbd1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:59.405372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:59.448162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3c728-54d1-46b8-ab7c-d2c26560bbd1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:59.482543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee94af9-3276-4633-8433-5dfe3cc729d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:59.483218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee94af9-3276-4633-8433-5dfe3cc729d8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:59.483531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee94af9-3276-4633-8433-5dfe3cc729d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:59.483782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee94af9-3276-4633-8433-5dfe3cc729d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:59.494270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee94af9-3276-4633-8433-5dfe3cc729d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5ee94af9-3276-4633-8433-5dfe3cc729d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:10:59.499284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:10:59.500156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:10:59.500971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 92/191] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:10:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:10:59.507325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef42da-1e92-4614-b391-582b51bae199 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:59.507488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee94af9-3276-4633-8433-5dfe3cc729d8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:59.615429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef42da-1e92-4614-b391-582b51bae199 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:59.620167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee94af9-3276-4633-8433-5dfe3cc729d8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:59.643254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:59.653321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44dc8-a371-4fa3-984d-f65d5a78ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:59.653955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44dc8-a371-4fa3-984d-f65d5a78ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:59.654269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44dc8-a371-4fa3-984d-f65d5a78ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:59.654497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44dc8-a371-4fa3-984d-f65d5a78ebd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:59.655676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44dc8-a371-4fa3-984d-f65d5a78ebd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:59.656141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b0a53-2724-4395-b0a6-41277e237c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:59.656754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b0a53-2724-4395-b0a6-41277e237c8c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:59.657030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b0a53-2724-4395-b0a6-41277e237c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:59.657118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44dc8-a371-4fa3-984d-f65d5a78ebd7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:59.657304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b0a53-2724-4395-b0a6-41277e237c8c None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:59.657956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b0a53-2724-4395-b0a6-41277e237c8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:10:59.658257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b0a53-2724-4395-b0a6-41277e237c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:59.658925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 100/192] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:10:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:59.659662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b0a53-2724-4395-b0a6-41277e237c8c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:59.664650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44dc8-a371-4fa3-984d-f65d5a78ebd7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:59.669747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 93/193] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:10:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:10:59.675307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b0a53-2724-4395-b0a6-41277e237c8c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:59.695563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:59.765045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44dc8-a371-4fa3-984d-f65d5a78ebd7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:59.776969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b0a53-2724-4395-b0a6-41277e237c8c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:59.798039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f0f82-c4fa-41f7-9dd0-b06ffaa70f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:59.798648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f0f82-c4fa-41f7-9dd0-b06ffaa70f1e None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:59.798956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f0f82-c4fa-41f7-9dd0-b06ffaa70f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:59.799226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f0f82-c4fa-41f7-9dd0-b06ffaa70f1e None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:59.799879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f0f82-c4fa-41f7-9dd0-b06ffaa70f1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:59.801319 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f0f82-c4fa-41f7-9dd0-b06ffaa70f1e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:59.810069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7f77a-cdf1-4b10-9d39-3a43dac4b04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:59.810707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7f77a-cdf1-4b10-9d39-3a43dac4b04d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:59.811020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7f77a-cdf1-4b10-9d39-3a43dac4b04d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:59.811293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7f77a-cdf1-4b10-9d39-3a43dac4b04d None admin] PATH_INFO: `/v3/users/550ef0afa2124dd4bd44875449599bf8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:59.825218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7f77a-cdf1-4b10-9d39-3a43dac4b04d None admin] RBAC: Authorizing `identity:get_user(user_id=550ef0afa2124dd4bd44875449599bf8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:59.826752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7f77a-cdf1-4b10-9d39-3a43dac4b04d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:59.828547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 94/194] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:10:59 2022] GET /identity/v3/users/550ef0afa2124dd4bd44875449599bf8 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:10:59.835527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7ee27-80bf-4cb5-8dd9-9f6f602066d8 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:59.835527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7ee27-80bf-4cb5-8dd9-9f6f602066d8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:59.835527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7ee27-80bf-4cb5-8dd9-9f6f602066d8 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:59.835527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 95/195] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:59.835527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7ee27-80bf-4cb5-8dd9-9f6f602066d8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:59.835838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 101/196] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:10:59 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:10:59.849086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb988-211e-4a6d-9f56-81760573ef0f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:59.849367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb988-211e-4a6d-9f56-81760573ef0f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:59.849640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fb988-211e-4a6d-9f56-81760573ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:59.869135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-222fb988-211e-4a6d-9f56-81760573ef0f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:59.870359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-222fb988-211e-4a6d-9f56-81760573ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:59.889429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:10:59.958903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 102/197] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:10:59.967905 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7ee27-80bf-4cb5-8dd9-9f6f602066d8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:00.006302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf592f3-84bd-4777-ae05-e941fd2eaead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:00.006967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf592f3-84bd-4777-ae05-e941fd2eaead None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.007253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf592f3-84bd-4777-ae05-e941fd2eaead None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.007531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf592f3-84bd-4777-ae05-e941fd2eaead None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.008720 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf592f3-84bd-4777-ae05-e941fd2eaead None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:00.010178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf592f3-84bd-4777-ae05-e941fd2eaead None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:00.012228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 96/198] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:10:59 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:00.018278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fb988-211e-4a6d-9f56-81760573ef0f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:00.038176 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:00.123481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fb988-211e-4a6d-9f56-81760573ef0f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:00.158181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bd20-80bc-480e-aeb3-b45353e051f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:00.158890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bd20-80bc-480e-aeb3-b45353e051f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.159217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bd20-80bc-480e-aeb3-b45353e051f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.159432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bd20-80bc-480e-aeb3-b45353e051f0 None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3/users/550ef0afa2124dd4bd44875449599bf8/roles/8c10cd5042ab49e6a1276dd0450cc2f8` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.161345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34bd20-80bc-480e-aeb3-b45353e051f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f6bde32c8f64180821a289d7647aab3, user_id=550ef0afa2124dd4bd44875449599bf8, role_id=8c10cd5042ab49e6a1276dd0450cc2f8)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:00.162823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34bd20-80bc-480e-aeb3-b45353e051f0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:00.177547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 103/199] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:00 2022] PUT /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3/users/550ef0afa2124dd4bd44875449599bf8/roles/8c10cd5042ab49e6a1276dd0450cc2f8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:00.222877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf592f3-84bd-4777-ae05-e941fd2eaead None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:00.342325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf592f3-84bd-4777-ae05-e941fd2eaead None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:00.355568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:00.382852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31178b09-df33-4a5f-b996-891cab23d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:00.383880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31178b09-df33-4a5f-b996-891cab23d9fa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.384366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31178b09-df33-4a5f-b996-891cab23d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.384643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31178b09-df33-4a5f-b996-891cab23d9fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.396151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31178b09-df33-4a5f-b996-891cab23d9fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-31178b09-df33-4a5f-b996-891cab23d9fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:00.401191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:00.402040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:00.402865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 97/200] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:00.408487 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bd20-80bc-480e-aeb3-b45353e051f0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:00.488907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:00.512883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bd20-80bc-480e-aeb3-b45353e051f0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:00.547104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02998d2e-7836-436c-8a65-d3e3dc63eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:00.547726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02998d2e-7836-436c-8a65-d3e3dc63eb66 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.548061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02998d2e-7836-436c-8a65-d3e3dc63eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.548340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02998d2e-7836-436c-8a65-d3e3dc63eb66 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.549015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02998d2e-7836-436c-8a65-d3e3dc63eb66 None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:00.549322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02998d2e-7836-436c-8a65-d3e3dc63eb66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:00.550790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02998d2e-7836-436c-8a65-d3e3dc63eb66 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:00.559708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 104/201] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:00.565481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31178b09-df33-4a5f-b996-891cab23d9fa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:00.670031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31178b09-df33-4a5f-b996-891cab23d9fa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:00.704495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e088c-1716-4522-8c85-f0c282e75626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:00.705148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e088c-1716-4522-8c85-f0c282e75626 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.705431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e088c-1716-4522-8c85-f0c282e75626 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.705704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e088c-1716-4522-8c85-f0c282e75626 None admin] PATH_INFO: `/v3/users/5f01b4b877f042b6ab0fb5119518a306` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.706870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e088c-1716-4522-8c85-f0c282e75626 None admin] RBAC: Authorizing `identity:get_user(user_id=5f01b4b877f042b6ab0fb5119518a306)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:00.708428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e088c-1716-4522-8c85-f0c282e75626 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:00.710307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 98/202] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:11:00 2022] GET /identity/v3/users/5f01b4b877f042b6ab0fb5119518a306 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:00.715729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02998d2e-7836-436c-8a65-d3e3dc63eb66 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:00.818220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02998d2e-7836-436c-8a65-d3e3dc63eb66 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:00.852943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d4ec7-f8f9-4818-8351-43feb50dd1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:00.853570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d4ec7-f8f9-4818-8351-43feb50dd1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.853844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d4ec7-f8f9-4818-8351-43feb50dd1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.854116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d4ec7-f8f9-4818-8351-43feb50dd1b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.863012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:00.934694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d4ec7-f8f9-4818-8351-43feb50dd1b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:00.936234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d4ec7-f8f9-4818-8351-43feb50dd1b5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:01.037181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 105/203] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:01.043812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e088c-1716-4522-8c85-f0c282e75626 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:01.091161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:01.147771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e088c-1716-4522-8c85-f0c282e75626 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:01.184347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc06c2-3a3b-46ef-beca-478a1784047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:01.185004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc06c2-3a3b-46ef-beca-478a1784047f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:01.185282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc06c2-3a3b-46ef-beca-478a1784047f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:01.185556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc06c2-3a3b-46ef-beca-478a1784047f None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:01.186701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc06c2-3a3b-46ef-beca-478a1784047f None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:01.188182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc06c2-3a3b-46ef-beca-478a1784047f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:01.190120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 99/204] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:11:01 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:01.195937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d4ec7-f8f9-4818-8351-43feb50dd1b5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:01.235870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:01.295997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d4ec7-f8f9-4818-8351-43feb50dd1b5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:01.329878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5517a-7032-44d5-805b-97aa14855786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:01.330494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5517a-7032-44d5-805b-97aa14855786 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:01.330798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5517a-7032-44d5-805b-97aa14855786 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:01.331076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5517a-7032-44d5-805b-97aa14855786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:01.331816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5517a-7032-44d5-805b-97aa14855786 None admin] RBAC: Adding query filter params (role.id=9145b5c6668a409d854e7d0c4491d775, scope.project.id=8f6bde32c8f64180821a289d7647aab3, user.id=5f01b4b877f042b6ab0fb5119518a306) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:01.332126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5517a-7032-44d5-805b-97aa14855786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:01.333566 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5517a-7032-44d5-805b-97aa14855786 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:01.339583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 106/205] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:01 2022] GET /identity/v3/role_assignments?user.id=5f01b4b877f042b6ab0fb5119518a306&scope.project.id=8f6bde32c8f64180821a289d7647aab3&role.id=9145b5c6668a409d854e7d0c4491d775 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:02.156780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91520406-985d-4f29-8266-dc5732b334e7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.157276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91520406-985d-4f29-8266-dc5732b334e7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.157351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91520406-985d-4f29-8266-dc5732b334e7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.158795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 100/206] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:02.164164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc3bf-05ee-429d-ab2a-f39b6e47f291 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.164578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc3bf-05ee-429d-ab2a-f39b6e47f291 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.164744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc3bf-05ee-429d-ab2a-f39b6e47f291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.184205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-663fc3bf-05ee-429d-ab2a-f39b6e47f291 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:02.185470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-663fc3bf-05ee-429d-ab2a-f39b6e47f291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:02.205257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed03a-97db-4b76-9987-5b9ea866d914 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.205570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed03a-97db-4b76-9987-5b9ea866d914 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.205806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed03a-97db-4b76-9987-5b9ea866d914 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.207307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 101/207] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:02.214513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9031bb-25f2-4bd5-b96b-1b92546af373 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.215252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9031bb-25f2-4bd5-b96b-1b92546af373 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.215733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9031bb-25f2-4bd5-b96b-1b92546af373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.235700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fc9031bb-25f2-4bd5-b96b-1b92546af373 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:02.236893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fc9031bb-25f2-4bd5-b96b-1b92546af373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:02.256461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 107/208] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:02.308345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 102/209] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:02.421488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd78b8-9230-4009-861e-f38dbf59d5c5 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.421667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd78b8-9230-4009-861e-f38dbf59d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.421935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd78b8-9230-4009-861e-f38dbf59d5c5 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.423515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 108/210] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:02.428664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2871dc5-e91e-4740-82a1-1667a9b4524c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.428927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2871dc5-e91e-4740-82a1-1667a9b4524c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.429223 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2871dc5-e91e-4740-82a1-1667a9b4524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.448350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f2871dc5-e91e-4740-82a1-1667a9b4524c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:02.449522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f2871dc5-e91e-4740-82a1-1667a9b4524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:02.480578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:02.517599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd78b8-9230-4009-861e-f38dbf59d5c5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:02.519427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 103/211] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:02.549347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:02.570315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2871dc5-e91e-4740-82a1-1667a9b4524c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:02.625352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd78b8-9230-4009-861e-f38dbf59d5c5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:02.658932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa17251-68d8-4dce-ad10-ef6c81270485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:02.659573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa17251-68d8-4dce-ad10-ef6c81270485 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.659850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa17251-68d8-4dce-ad10-ef6c81270485 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.660116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa17251-68d8-4dce-ad10-ef6c81270485 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.669865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa17251-68d8-4dce-ad10-ef6c81270485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-faa17251-68d8-4dce-ad10-ef6c81270485 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:02.674772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:02.675889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:02.676840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 109/212] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:02.681646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa17251-68d8-4dce-ad10-ef6c81270485 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:02.683184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2871dc5-e91e-4740-82a1-1667a9b4524c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:02.723258 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408641b7-78fd-4e3c-94cc-2f9012b3f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:02.724627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408641b7-78fd-4e3c-94cc-2f9012b3f889 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.725050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408641b7-78fd-4e3c-94cc-2f9012b3f889 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.725888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408641b7-78fd-4e3c-94cc-2f9012b3f889 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.727563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408641b7-78fd-4e3c-94cc-2f9012b3f889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:02.730192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408641b7-78fd-4e3c-94cc-2f9012b3f889 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:02.732609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 104/213] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:02.738173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408641b7-78fd-4e3c-94cc-2f9012b3f889 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:02.772942 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:02.783124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:02.791599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa17251-68d8-4dce-ad10-ef6c81270485 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:02.825701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a1f2-b1f3-4964-9fae-84ffb4314e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:02.826308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a1f2-b1f3-4964-9fae-84ffb4314e95 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.826580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a1f2-b1f3-4964-9fae-84ffb4314e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.826878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a1f2-b1f3-4964-9fae-84ffb4314e95 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.827543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a1f2-b1f3-4964-9fae-84ffb4314e95 None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:02.827842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a1f2-b1f3-4964-9fae-84ffb4314e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:02.829269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a1f2-b1f3-4964-9fae-84ffb4314e95 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:02.837305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 110/214] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:02.838095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a1f2-b1f3-4964-9fae-84ffb4314e95 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:02.846330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408641b7-78fd-4e3c-94cc-2f9012b3f889 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:02.880412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d709d-1166-41b3-b3a0-17ef718fdbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:02.881027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d709d-1166-41b3-b3a0-17ef718fdbf7 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.881309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d709d-1166-41b3-b3a0-17ef718fdbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.881582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d709d-1166-41b3-b3a0-17ef718fdbf7 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.882281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d709d-1166-41b3-b3a0-17ef718fdbf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:02.883790 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d709d-1166-41b3-b3a0-17ef718fdbf7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:02.905320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 105/215] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:11:02 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:11:02.907727 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d709d-1166-41b3-b3a0-17ef718fdbf7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:02.946595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a1f2-b1f3-4964-9fae-84ffb4314e95 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:02.983935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63350dfd-6190-4697-ac82-218d37b9afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:02.984896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63350dfd-6190-4697-ac82-218d37b9afa1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:02.985311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63350dfd-6190-4697-ac82-218d37b9afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:02.985721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63350dfd-6190-4697-ac82-218d37b9afa1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:02.997951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63350dfd-6190-4697-ac82-218d37b9afa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-63350dfd-6190-4697-ac82-218d37b9afa1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:03.004659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:03.005821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:11:03.006833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:03.008984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 111/216] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:03.015694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63350dfd-6190-4697-ac82-218d37b9afa1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:03.025656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:03.033586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:03.037986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d709d-1166-41b3-b3a0-17ef718fdbf7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:03.075149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82a50d-137e-4033-9c2a-d38da1235a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:03.075813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82a50d-137e-4033-9c2a-d38da1235a5b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.076093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82a50d-137e-4033-9c2a-d38da1235a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.076365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82a50d-137e-4033-9c2a-d38da1235a5b None admin] PATH_INFO: `/v3/users/0a4e8caea2e0489f8120fc581e12d245` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.091739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82a50d-137e-4033-9c2a-d38da1235a5b None admin] RBAC: Authorizing `identity:get_user(user_id=0a4e8caea2e0489f8120fc581e12d245)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:03.094457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82a50d-137e-4033-9c2a-d38da1235a5b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:03.095776 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 106/217] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:11:02 2022] GET /identity/v3/users/0a4e8caea2e0489f8120fc581e12d245 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:03.105793 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82a50d-137e-4033-9c2a-d38da1235a5b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:03.137494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63350dfd-6190-4697-ac82-218d37b9afa1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:03.180591 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c4e94-9273-4145-8af9-85093ef654b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:03.181335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c4e94-9273-4145-8af9-85093ef654b8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.181615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c4e94-9273-4145-8af9-85093ef654b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.181886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c4e94-9273-4145-8af9-85093ef654b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.182676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c4e94-9273-4145-8af9-85093ef654b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:03.183061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c4e94-9273-4145-8af9-85093ef654b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:03.184459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c4e94-9273-4145-8af9-85093ef654b8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:03.196141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 112/218] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:03.201146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c4e94-9273-4145-8af9-85093ef654b8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:03.233368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82a50d-137e-4033-9c2a-d38da1235a5b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:03.295534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35cbfe-a26a-471c-a227-cb108dbb6cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:03.296579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35cbfe-a26a-471c-a227-cb108dbb6cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.297614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35cbfe-a26a-471c-a227-cb108dbb6cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.298088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35cbfe-a26a-471c-a227-cb108dbb6cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.299702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:03.300938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35cbfe-a26a-471c-a227-cb108dbb6cb9 None admin] RBAC: Adding query filter params (role.id=9145b5c6668a409d854e7d0c4491d775, user.id=0a4e8caea2e0489f8120fc581e12d245, scope.system=all) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:03.301840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35cbfe-a26a-471c-a227-cb108dbb6cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:03.303827 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35cbfe-a26a-471c-a227-cb108dbb6cb9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:03.312070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 107/219] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Oct 27 01:11:03 2022] GET /identity/v3/role_assignments?user.id=0a4e8caea2e0489f8120fc581e12d245&scope.system=all&role.id=9145b5c6668a409d854e7d0c4491d775 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:03.334302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c4e94-9273-4145-8af9-85093ef654b8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:03.375138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5111687-9fa6-4f16-a5de-34f23a7e52de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:03.376219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5111687-9fa6-4f16-a5de-34f23a7e52de None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.376759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5111687-9fa6-4f16-a5de-34f23a7e52de None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.377229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5111687-9fa6-4f16-a5de-34f23a7e52de None admin] PATH_INFO: `/v3/users/550ef0afa2124dd4bd44875449599bf8` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.378855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5111687-9fa6-4f16-a5de-34f23a7e52de None admin] RBAC: Authorizing `identity:get_user(user_id=550ef0afa2124dd4bd44875449599bf8)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:03.380602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5111687-9fa6-4f16-a5de-34f23a7e52de None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:03.382754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 113/220] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:11:03 2022] GET /identity/v3/users/550ef0afa2124dd4bd44875449599bf8 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:03.392225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35cbfe-a26a-471c-a227-cb108dbb6cb9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:03.410069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:03.509025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35cbfe-a26a-471c-a227-cb108dbb6cb9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:03.545517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5619d-c2e7-4f35-b410-ddd1f71add64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:03.546529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5619d-c2e7-4f35-b410-ddd1f71add64 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.547027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5619d-c2e7-4f35-b410-ddd1f71add64 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.547492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5619d-c2e7-4f35-b410-ddd1f71add64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.617421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5619d-c2e7-4f35-b410-ddd1f71add64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:03.619412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5619d-c2e7-4f35-b410-ddd1f71add64 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:03.638300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:03.726729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 108/221] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:03.732590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5111687-9fa6-4f16-a5de-34f23a7e52de None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:03.836507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5111687-9fa6-4f16-a5de-34f23a7e52de None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:03.871541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8649d5-ba7c-4baf-8524-080861e07d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:03.872187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8649d5-ba7c-4baf-8524-080861e07d0b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.872466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8649d5-ba7c-4baf-8524-080861e07d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.872730 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8649d5-ba7c-4baf-8524-080861e07d0b None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.873841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8649d5-ba7c-4baf-8524-080861e07d0b None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:03.875323 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8649d5-ba7c-4baf-8524-080861e07d0b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:03.876966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 114/222] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:11:03 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:03.883140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5619d-c2e7-4f35-b410-ddd1f71add64 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:03.994564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5619d-c2e7-4f35-b410-ddd1f71add64 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:04.008474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:04.030136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c48a7-ef34-4694-858d-387ef97e92bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:04.030769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c48a7-ef34-4694-858d-387ef97e92bf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:04.031052 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c48a7-ef34-4694-858d-387ef97e92bf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:04.031325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c48a7-ef34-4694-858d-387ef97e92bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:04.032066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c48a7-ef34-4694-858d-387ef97e92bf None admin] RBAC: Adding query filter params (role.id=8c10cd5042ab49e6a1276dd0450cc2f8, scope.project.id=8f6bde32c8f64180821a289d7647aab3, user.id=550ef0afa2124dd4bd44875449599bf8) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:04.032373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c48a7-ef34-4694-858d-387ef97e92bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:04.033814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c48a7-ef34-4694-858d-387ef97e92bf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:04.039919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 109/223] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:03 2022] GET /identity/v3/role_assignments?user.id=550ef0afa2124dd4bd44875449599bf8&scope.project.id=8f6bde32c8f64180821a289d7647aab3&role.id=8c10cd5042ab49e6a1276dd0450cc2f8 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:05.222281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaecc2d-3980-4a3a-b286-56230449d2d2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.223057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaecc2d-3980-4a3a-b286-56230449d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.223057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaecc2d-3980-4a3a-b286-56230449d2d2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.224195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 115/224] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:05.229778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565b8d-357f-4174-8b6c-2336cd13ea04 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.230197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565b8d-357f-4174-8b6c-2336cd13ea04 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.230270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565b8d-357f-4174-8b6c-2336cd13ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.245175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb308fb7-760e-45c0-a9b9-a44215a4a15d None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.245459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb308fb7-760e-45c0-a9b9-a44215a4a15d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.245728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb308fb7-760e-45c0-a9b9-a44215a4a15d None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.247257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 116/225] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:11:05.249075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5e565b8d-357f-4174-8b6c-2336cd13ea04 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:05.250268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5e565b8d-357f-4174-8b6c-2336cd13ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:05.252006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10b12b-4588-4d31-9d54-a855d9a1071f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.252609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10b12b-4588-4d31-9d54-a855d9a1071f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.252885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10b12b-4588-4d31-9d54-a855d9a1071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.273975 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9e10b12b-4588-4d31-9d54-a855d9a1071f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:05.275186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9e10b12b-4588-4d31-9d54-a855d9a1071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:05.282454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:05.317336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 110/226] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:05.343872 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 117/227] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:05.495780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29ade-3224-4646-a505-c712b77dcee2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.495957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29ade-3224-4646-a505-c712b77dcee2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.496196 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29ade-3224-4646-a505-c712b77dcee2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.497752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 111/228] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:05.502966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf71b9-db48-4843-9c1c-0b429116a826 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.503259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf71b9-db48-4843-9c1c-0b429116a826 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.503540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf71b9-db48-4843-9c1c-0b429116a826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.522420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1eaf71b9-db48-4843-9c1c-0b429116a826 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:05.523687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1eaf71b9-db48-4843-9c1c-0b429116a826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:05.582121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29ade-3224-4646-a505-c712b77dcee2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:05.592178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 118/229] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:05.611669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf71b9-db48-4843-9c1c-0b429116a826 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:05.684518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:05.686084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29ade-3224-4646-a505-c712b77dcee2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:05.694772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:05.718083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf71b9-db48-4843-9c1c-0b429116a826 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:05.724780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155528-41bb-4970-a04b-5993982c8e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:05.725427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155528-41bb-4970-a04b-5993982c8e69 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.726210 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155528-41bb-4970-a04b-5993982c8e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.726485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155528-41bb-4970-a04b-5993982c8e69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.727673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c155528-41bb-4970-a04b-5993982c8e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:05.729992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c155528-41bb-4970-a04b-5993982c8e69 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:05.732085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 112/230] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:05.737316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155528-41bb-4970-a04b-5993982c8e69 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:05.761269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8073-6f6a-496d-bb3b-d0450fa987df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:05.762199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8073-6f6a-496d-bb3b-d0450fa987df None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.762486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8073-6f6a-496d-bb3b-d0450fa987df None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.762786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8073-6f6a-496d-bb3b-d0450fa987df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.773821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d8073-6f6a-496d-bb3b-d0450fa987df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-832d8073-6f6a-496d-bb3b-d0450fa987df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:05.778693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:05.779581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:05.780379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 119/231] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:05.787014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8073-6f6a-496d-bb3b-d0450fa987df None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:05.844561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155528-41bb-4970-a04b-5993982c8e69 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:05.880981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae49921-0051-4e57-8142-ee9a21b1b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:05.880981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae49921-0051-4e57-8142-ee9a21b1b0f3 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.881252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae49921-0051-4e57-8142-ee9a21b1b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.881496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae49921-0051-4e57-8142-ee9a21b1b0f3 None admin] PATH_INFO: `/v3/groups` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.882130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae49921-0051-4e57-8142-ee9a21b1b0f3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:05.883657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae49921-0051-4e57-8142-ee9a21b1b0f3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:05.899480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 113/232] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Oct 27 01:11:05 2022] POST /identity/v3/groups => generated 229 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:11:05.900829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8073-6f6a-496d-bb3b-d0450fa987df None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:05.907492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae49921-0051-4e57-8142-ee9a21b1b0f3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:05.935327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:05.940927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721a460-df0a-4126-bc0e-25bfbcc07d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:05.941569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721a460-df0a-4126-bc0e-25bfbcc07d2e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:05.942240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721a460-df0a-4126-bc0e-25bfbcc07d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:05.942936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721a460-df0a-4126-bc0e-25bfbcc07d2e None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:05.944019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721a460-df0a-4126-bc0e-25bfbcc07d2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:05.944415 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721a460-df0a-4126-bc0e-25bfbcc07d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:05.946079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721a460-df0a-4126-bc0e-25bfbcc07d2e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:05.953845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:05.955550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 120/233] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:05.961851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721a460-df0a-4126-bc0e-25bfbcc07d2e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:06.029919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae49921-0051-4e57-8142-ee9a21b1b0f3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:06.065699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eceb8-4b3c-4ae0-9264-bd3e2cd1ed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:06.066365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eceb8-4b3c-4ae0-9264-bd3e2cd1ed47 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:06.066648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eceb8-4b3c-4ae0-9264-bd3e2cd1ed47 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:06.066945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eceb8-4b3c-4ae0-9264-bd3e2cd1ed47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:06.076091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721a460-df0a-4126-bc0e-25bfbcc07d2e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:06.077970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21eceb8-4b3c-4ae0-9264-bd3e2cd1ed47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d21eceb8-4b3c-4ae0-9264-bd3e2cd1ed47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:06.083473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:06.084560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:06.085538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 114/234] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:06.090568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eceb8-4b3c-4ae0-9264-bd3e2cd1ed47 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:06.116847 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8695a3d-3b2e-4fda-9dbf-9402689bc4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:06.117549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8695a3d-3b2e-4fda-9dbf-9402689bc4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:06.117834 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8695a3d-3b2e-4fda-9dbf-9402689bc4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:06.118107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8695a3d-3b2e-4fda-9dbf-9402689bc4b4 None admin] PATH_INFO: `/v3/users/fa7ceab58d4e4082a9fafab527352b49` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:06.132394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8695a3d-3b2e-4fda-9dbf-9402689bc4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=fa7ceab58d4e4082a9fafab527352b49)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:06.133913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8695a3d-3b2e-4fda-9dbf-9402689bc4b4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:06.135625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 121/235] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:11:05 2022] GET /identity/v3/users/fa7ceab58d4e4082a9fafab527352b49 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:06.141842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8695a3d-3b2e-4fda-9dbf-9402689bc4b4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:06.189660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:06.196985 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eceb8-4b3c-4ae0-9264-bd3e2cd1ed47 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:06.201831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:06.236419 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b581-78c8-4b14-82a4-8d425134cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:06.237099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b581-78c8-4b14-82a4-8d425134cc06 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:06.237520 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b581-78c8-4b14-82a4-8d425134cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:06.237649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b581-78c8-4b14-82a4-8d425134cc06 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:06.238259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0b581-78c8-4b14-82a4-8d425134cc06 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:06.238564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0b581-78c8-4b14-82a4-8d425134cc06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:06.239997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0b581-78c8-4b14-82a4-8d425134cc06 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:06.249146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 115/236] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:06.255025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b581-78c8-4b14-82a4-8d425134cc06 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:06.258424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8695a3d-3b2e-4fda-9dbf-9402689bc4b4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:06.294246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b090d33-41ec-45c4-bb41-7e65be3be9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:06.294908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b090d33-41ec-45c4-bb41-7e65be3be9ee None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:06.295250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b090d33-41ec-45c4-bb41-7e65be3be9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:06.295581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b090d33-41ec-45c4-bb41-7e65be3be9ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:06.296375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b090d33-41ec-45c4-bb41-7e65be3be9ee None admin] RBAC: Adding query filter params (role.id=8c10cd5042ab49e6a1276dd0450cc2f8, user.id=fa7ceab58d4e4082a9fafab527352b49, scope.system=all) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:06.296741 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b090d33-41ec-45c4-bb41-7e65be3be9ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:06.298362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b090d33-41ec-45c4-bb41-7e65be3be9ee None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:06.303988 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 122/237] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Oct 27 01:11:06 2022] GET /identity/v3/role_assignments?user.id=fa7ceab58d4e4082a9fafab527352b49&scope.system=all&role.id=8c10cd5042ab49e6a1276dd0450cc2f8 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:06.365926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b581-78c8-4b14-82a4-8d425134cc06 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:06.406297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fb103-94ed-4d57-8a49-c1c309ca12ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:06.407156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fb103-94ed-4d57-8a49-c1c309ca12ea None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:06.407530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fb103-94ed-4d57-8a49-c1c309ca12ea None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:06.407892 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fb103-94ed-4d57-8a49-c1c309ca12ea None admin] PATH_INFO: `/v3/users/0a4e8caea2e0489f8120fc581e12d245` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:06.409195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fb103-94ed-4d57-8a49-c1c309ca12ea None admin] RBAC: Authorizing `identity:get_user(user_id=0a4e8caea2e0489f8120fc581e12d245)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:06.410821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fb103-94ed-4d57-8a49-c1c309ca12ea None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:06.412744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 116/238] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:11:06 2022] GET /identity/v3/users/0a4e8caea2e0489f8120fc581e12d245 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:06.418394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b090d33-41ec-45c4-bb41-7e65be3be9ee None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:06.532299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b090d33-41ec-45c4-bb41-7e65be3be9ee None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:06.549749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:06.568281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6da64-b344-4fce-ac19-28e100c3fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:06.568957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6da64-b344-4fce-ac19-28e100c3fe88 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:06.569274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6da64-b344-4fce-ac19-28e100c3fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:06.569554 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6da64-b344-4fce-ac19-28e100c3fe88 None admin] PATH_INFO: `/v3/system/users/0a4e8caea2e0489f8120fc581e12d245/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:06.571142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6da64-b344-4fce-ac19-28e100c3fe88 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a4e8caea2e0489f8120fc581e12d245, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:06.572595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6da64-b344-4fce-ac19-28e100c3fe88 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:06.583744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 123/239] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Oct 27 01:11:06 2022] PUT /identity/v3/system/users/0a4e8caea2e0489f8120fc581e12d245/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:08.083137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70ab51-88bb-4b0d-bf9d-d9d35a423298 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:08.083704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70ab51-88bb-4b0d-bf9d-d9d35a423298 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:08.083704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70ab51-88bb-4b0d-bf9d-d9d35a423298 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:08.085186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 117/240] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:08.090377 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee37f4-343c-49dd-b43e-1f107b1d6899 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:08.090840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee37f4-343c-49dd-b43e-1f107b1d6899 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:08.090991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee37f4-343c-49dd-b43e-1f107b1d6899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:08.110107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-09ee37f4-343c-49dd-b43e-1f107b1d6899 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:08.111268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-09ee37f4-343c-49dd-b43e-1f107b1d6899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:08.182124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 124/241] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:08.422282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543d821-f011-4f67-bed1-fc03c2b04391 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:08.422487 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543d821-f011-4f67-bed1-fc03c2b04391 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:08.422779 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543d821-f011-4f67-bed1-fc03c2b04391 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:08.424265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 118/242] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:08.429393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9db0-538f-4df1-a80f-17f1ecee81fc None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:08.429740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9db0-538f-4df1-a80f-17f1ecee81fc None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:08.429992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9db0-538f-4df1-a80f-17f1ecee81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:08.446184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543d821-f011-4f67-bed1-fc03c2b04391 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:08.448607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-57eb9db0-538f-4df1-a80f-17f1ecee81fc None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:08.449779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-57eb9db0-538f-4df1-a80f-17f1ecee81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:08.472764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:08.523612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 125/243] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:08.563699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543d821-f011-4f67-bed1-fc03c2b04391 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:08.603288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f628fe4-ebc3-4344-8895-a0af59ce0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:08.604293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f628fe4-ebc3-4344-8895-a0af59ce0053 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:08.604769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f628fe4-ebc3-4344-8895-a0af59ce0053 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:08.605233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f628fe4-ebc3-4344-8895-a0af59ce0053 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:08.606540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f628fe4-ebc3-4344-8895-a0af59ce0053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:08.608221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f628fe4-ebc3-4344-8895-a0af59ce0053 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:08.610399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 119/244] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:08.615907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9db0-538f-4df1-a80f-17f1ecee81fc None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:08.659422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:08.686244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca7d68-8185-43f3-b225-ff7ef2c0e01b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:08.686511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca7d68-8185-43f3-b225-ff7ef2c0e01b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:08.686700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca7d68-8185-43f3-b225-ff7ef2c0e01b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:08.688234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 120/245] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:11:08.693147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914f9fb-65c0-4735-aaa3-dc5e0b814c3a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:08.693432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914f9fb-65c0-4735-aaa3-dc5e0b814c3a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:08.693698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914f9fb-65c0-4735-aaa3-dc5e0b814c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:08.714337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d914f9fb-65c0-4735-aaa3-dc5e0b814c3a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:08.715581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d914f9fb-65c0-4735-aaa3-dc5e0b814c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:08.722562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9db0-538f-4df1-a80f-17f1ecee81fc None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:08.759069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061108-373f-4356-8f33-9a075c7baa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:08.759731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061108-373f-4356-8f33-9a075c7baa5a None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:08.760019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061108-373f-4356-8f33-9a075c7baa5a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:08.760279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061108-373f-4356-8f33-9a075c7baa5a None admin] PATH_INFO: `/v3/groups` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:08.760925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1061108-373f-4356-8f33-9a075c7baa5a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:08.762771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1061108-373f-4356-8f33-9a075c7baa5a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:08.781277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 126/246] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Oct 27 01:11:08 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:11:08.789494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 121/247] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:08.791488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061108-373f-4356-8f33-9a075c7baa5a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:08.904910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:08.907922 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061108-373f-4356-8f33-9a075c7baa5a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:08.948359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93a67-3ada-4eda-93b0-387df4aba957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:08.948919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93a67-3ada-4eda-93b0-387df4aba957 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:08.949198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93a67-3ada-4eda-93b0-387df4aba957 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:08.949467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93a67-3ada-4eda-93b0-387df4aba957 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:08.962850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93a67-3ada-4eda-93b0-387df4aba957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-02d93a67-3ada-4eda-93b0-387df4aba957 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:08.967557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:08.968595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:08.969619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 127/248] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:08.976495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914f9fb-65c0-4735-aaa3-dc5e0b814c3a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:09.002000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:09.063192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93a67-3ada-4eda-93b0-387df4aba957 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:09.085980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914f9fb-65c0-4735-aaa3-dc5e0b814c3a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:09.137938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c8c7-6e61-4a25-ae51-ddfde5041ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:09.138590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c8c7-6e61-4a25-ae51-ddfde5041ecc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:09.138939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c8c7-6e61-4a25-ae51-ddfde5041ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:09.139274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c8c7-6e61-4a25-ae51-ddfde5041ecc None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:09.139959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49c8c7-6e61-4a25-ae51-ddfde5041ecc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:09.143063 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49c8c7-6e61-4a25-ae51-ddfde5041ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:09.144468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49c8c7-6e61-4a25-ae51-ddfde5041ecc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:09.155859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 122/249] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:09.163823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c8c7-6e61-4a25-ae51-ddfde5041ecc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:09.217140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93a67-3ada-4eda-93b0-387df4aba957 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:09.263553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384c746-5141-4465-af6a-8ae966a5aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:09.264237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384c746-5141-4465-af6a-8ae966a5aeea None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:09.264518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384c746-5141-4465-af6a-8ae966a5aeea None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:09.264856 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384c746-5141-4465-af6a-8ae966a5aeea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:09.278922 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384c746-5141-4465-af6a-8ae966a5aeea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-d384c746-5141-4465-af6a-8ae966a5aeea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:09.284226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:09.285115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:09.285888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:09.290481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 128/250] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:09.291091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:09.291965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384c746-5141-4465-af6a-8ae966a5aeea None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:09.315618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c8c7-6e61-4a25-ae51-ddfde5041ecc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:09.325024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:09.354236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901e3ec-ed5e-4c90-90b4-4f30ebfb80be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:09.354933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901e3ec-ed5e-4c90-90b4-4f30ebfb80be None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:09.355222 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901e3ec-ed5e-4c90-90b4-4f30ebfb80be None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:09.355495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901e3ec-ed5e-4c90-90b4-4f30ebfb80be None admin] PATH_INFO: `/v3/users/fa7ceab58d4e4082a9fafab527352b49` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:09.356749 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901e3ec-ed5e-4c90-90b4-4f30ebfb80be None admin] RBAC: Authorizing `identity:get_user(user_id=fa7ceab58d4e4082a9fafab527352b49)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:09.358309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901e3ec-ed5e-4c90-90b4-4f30ebfb80be None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:09.360144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 123/251] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:11:09 2022] GET /identity/v3/users/fa7ceab58d4e4082a9fafab527352b49 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:09.366318 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901e3ec-ed5e-4c90-90b4-4f30ebfb80be None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:09.416514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384c746-5141-4465-af6a-8ae966a5aeea None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:09.457636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda64f-6813-4ad9-994b-6f556c99ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:09.458859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda64f-6813-4ad9-994b-6f556c99ac5c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:09.459631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda64f-6813-4ad9-994b-6f556c99ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:09.460112 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda64f-6813-4ad9-994b-6f556c99ac5c None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:09.461112 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bda64f-6813-4ad9-994b-6f556c99ac5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:09.461616 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bda64f-6813-4ad9-994b-6f556c99ac5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:09.463992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bda64f-6813-4ad9-994b-6f556c99ac5c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:09.474494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 129/252] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:09.479911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901e3ec-ed5e-4c90-90b4-4f30ebfb80be None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:09.483983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda64f-6813-4ad9-994b-6f556c99ac5c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:09.522016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015988bb-a92f-4716-b736-b05de7c977e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:09.522840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015988bb-a92f-4716-b736-b05de7c977e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:09.523067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015988bb-a92f-4716-b736-b05de7c977e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:09.523385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015988bb-a92f-4716-b736-b05de7c977e8 None admin] PATH_INFO: `/v3/system/users/fa7ceab58d4e4082a9fafab527352b49/roles/8c10cd5042ab49e6a1276dd0450cc2f8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:09.525962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015988bb-a92f-4716-b736-b05de7c977e8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fa7ceab58d4e4082a9fafab527352b49, role_id=8c10cd5042ab49e6a1276dd0450cc2f8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:09.527431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015988bb-a92f-4716-b736-b05de7c977e8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:09.539239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 124/253] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Oct 27 01:11:09 2022] PUT /identity/v3/system/users/fa7ceab58d4e4082a9fafab527352b49/roles/8c10cd5042ab49e6a1276dd0450cc2f8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:11:09.587743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:09.608394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda64f-6813-4ad9-994b-6f556c99ac5c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:09.647788 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589f98e-28f7-4cb6-ad9b-da30e33a4577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:09.648547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f98e-28f7-4cb6-ad9b-da30e33a4577 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:09.648833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f98e-28f7-4cb6-ad9b-da30e33a4577 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:09.649115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f98e-28f7-4cb6-ad9b-da30e33a4577 None admin] PATH_INFO: `/v3/users/0a4e8caea2e0489f8120fc581e12d245` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:09.650353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589f98e-28f7-4cb6-ad9b-da30e33a4577 None admin] RBAC: Authorizing `identity:get_user(user_id=0a4e8caea2e0489f8120fc581e12d245)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:09.651985 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589f98e-28f7-4cb6-ad9b-da30e33a4577 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:09.654180 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 130/254] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:11:09 2022] GET /identity/v3/users/0a4e8caea2e0489f8120fc581e12d245 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:09.660490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015988bb-a92f-4716-b736-b05de7c977e8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:09.682592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:09.779284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015988bb-a92f-4716-b736-b05de7c977e8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:09.815449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f0aa0-deb2-4d78-a4d7-361f04594efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:09.816429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f0aa0-deb2-4d78-a4d7-361f04594efb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:09.816902 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f0aa0-deb2-4d78-a4d7-361f04594efb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:09.817366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f0aa0-deb2-4d78-a4d7-361f04594efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:09.818319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f0aa0-deb2-4d78-a4d7-361f04594efb None admin] RBAC: Adding query filter params (role.id=9145b5c6668a409d854e7d0c4491d775, user.id=0a4e8caea2e0489f8120fc581e12d245, scope.system=all) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:09.818869 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f0aa0-deb2-4d78-a4d7-361f04594efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:09.820589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f0aa0-deb2-4d78-a4d7-361f04594efb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:09.836097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 125/255] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Oct 27 01:11:09 2022] GET /identity/v3/role_assignments?user.id=0a4e8caea2e0489f8120fc581e12d245&scope.system=all&role.id=9145b5c6668a409d854e7d0c4491d775 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:11.754277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765694-0043-439f-82be-bcb2534906db None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:11.754821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765694-0043-439f-82be-bcb2534906db None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:11.754897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765694-0043-439f-82be-bcb2534906db None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:11.756377 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 131/256] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:11.764539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf186e32-c9be-463c-9b68-890d72d95351 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:11.765424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf186e32-c9be-463c-9b68-890d72d95351 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:11.765925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf186e32-c9be-463c-9b68-890d72d95351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:11.779104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885e1d9-13bf-4437-b594-ccea6d3075a9 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:11.779406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885e1d9-13bf-4437-b594-ccea6d3075a9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:11.779689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885e1d9-13bf-4437-b594-ccea6d3075a9 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:11.782596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 132/257] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:11.788733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57ddf-5ac3-453c-ab9f-69517afe4690 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:11.789145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57ddf-5ac3-453c-ab9f-69517afe4690 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:11.789434 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e57ddf-5ac3-453c-ab9f-69517afe4690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:11.794623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bf186e32-c9be-463c-9b68-890d72d95351 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:11.796084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bf186e32-c9be-463c-9b68-890d72d95351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:11.817161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-69e57ddf-5ac3-453c-ab9f-69517afe4690 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:11.818541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-69e57ddf-5ac3-453c-ab9f-69517afe4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:11.902235 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 126/258] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 01:11:11.925080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 133/259] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 27 01:11:12.269877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cf119-1ca5-48d1-921c-1dcc6a7ab5f7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.270211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cf119-1ca5-48d1-921c-1dcc6a7ab5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.270578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cf119-1ca5-48d1-921c-1dcc6a7ab5f7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.272141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 127/260] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:12.277745 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ca20-3cd7-4468-80fd-a2b5b2e8d758 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.278039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ca20-3cd7-4468-80fd-a2b5b2e8d758 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.278320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ca20-3cd7-4468-80fd-a2b5b2e8d758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.304298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a335ca20-3cd7-4468-80fd-a2b5b2e8d758 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:12.305641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a335ca20-3cd7-4468-80fd-a2b5b2e8d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:12.387528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 134/261] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:12.451077 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cf119-1ca5-48d1-921c-1dcc6a7ab5f7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.468385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cf119-1ca5-48d1-921c-1dcc6a7ab5f7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.473527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6c76-3ac6-4dff-8127-0e37bb160cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.474314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6c76-3ac6-4dff-8127-0e37bb160cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.475035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6c76-3ac6-4dff-8127-0e37bb160cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.475035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6c76-3ac6-4dff-8127-0e37bb160cd8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.491235 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa6c76-3ac6-4dff-8127-0e37bb160cd8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0aaa6c76-3ac6-4dff-8127-0e37bb160cd8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:12.499490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:12.500381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:12.501150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 128/262] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Oct 27 01:11:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:12.508241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335ca20-3cd7-4468-80fd-a2b5b2e8d758 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.524739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335ca20-3cd7-4468-80fd-a2b5b2e8d758 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.532238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.532901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.533189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.533539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.534229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:12.534567 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:12.536524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:11:12.536524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: warnings.warn(msg) Oct 27 01:11:12.536524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: Oct 27 01:11:12.537447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:12.547369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 135/263] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Oct 27 01:11:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:12.553093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6c76-3ac6-4dff-8127-0e37bb160cd8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.571894 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6c76-3ac6-4dff-8127-0e37bb160cd8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.577497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c652104-fa2f-42d5-9d57-08333bbf721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.578198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652104-fa2f-42d5-9d57-08333bbf721e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.578759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652104-fa2f-42d5-9d57-08333bbf721e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.579737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652104-fa2f-42d5-9d57-08333bbf721e admin admin] PATH_INFO: `/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.585054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:12.591769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c652104-fa2f-42d5-9d57-08333bbf721e admin admin] RBAC: Authorizing `identity:get_group(group_id=4e52c426e0ba483cbbb47c5d0093f5d2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:12.594641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-6c652104-fa2f-42d5-9d57-08333bbf721e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:11:12.594641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: warnings.warn(msg) Oct 27 01:11:12.594641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: Oct 27 01:11:12.595949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c652104-fa2f-42d5-9d57-08333bbf721e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:12.597844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 129/264] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Oct 27 01:11:12 2022] GET /identity/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:12.603986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.605702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c652104-fa2f-42d5-9d57-08333bbf721e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.618404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c652104-fa2f-42d5-9d57-08333bbf721e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.623112 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7f868-61c6-447a-8a63-adf0745980c3 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.629607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405815e-2104-46ce-acf0-f65919be3d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.631558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405815e-2104-46ce-acf0-f65919be3d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.631830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405815e-2104-46ce-acf0-f65919be3d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.632103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405815e-2104-46ce-acf0-f65919be3d53 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.633491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc2712-f560-4d7f-8fa6-5d960112c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.634194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc2712-f560-4d7f-8fa6-5d960112c01b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.634472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc2712-f560-4d7f-8fa6-5d960112c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.634762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc2712-f560-4d7f-8fa6-5d960112c01b admin admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.638240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc2712-f560-4d7f-8fa6-5d960112c01b admin admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:12.642422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc2712-f560-4d7f-8fa6-5d960112c01b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:12.646459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 136/265] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Oct 27 01:11:12 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:12.652799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc2712-f560-4d7f-8fa6-5d960112c01b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.660882 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405815e-2104-46ce-acf0-f65919be3d53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c405815e-2104-46ce-acf0-f65919be3d53 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:12.668641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:12.670608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:12.672624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 130/266] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Oct 27 01:11:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:12.674163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc2712-f560-4d7f-8fa6-5d960112c01b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.680357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff811bde-e70f-4333-962c-4e38463e15ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.681091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff811bde-e70f-4333-962c-4e38463e15ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.681373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff811bde-e70f-4333-962c-4e38463e15ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.681649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff811bde-e70f-4333-962c-4e38463e15ea admin admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51/groups/4e52c426e0ba483cbbb47c5d0093f5d2/roles/375d0d25eaa04686ba41303116106916` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.685068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff811bde-e70f-4333-962c-4e38463e15ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d297e3933cee44408a03ee5029e09d51, group_id=4e52c426e0ba483cbbb47c5d0093f5d2, role_id=375d0d25eaa04686ba41303116106916)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:12.686093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-ff811bde-e70f-4333-962c-4e38463e15ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:11:12.686093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: warnings.warn(msg) Oct 27 01:11:12.686093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: Oct 27 01:11:12.688182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff811bde-e70f-4333-962c-4e38463e15ea admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:12.694143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405815e-2104-46ce-acf0-f65919be3d53 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.706297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405815e-2104-46ce-acf0-f65919be3d53 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.714614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:12.720977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 137/267] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Oct 27 01:11:12 2022] PUT /identity/v3/projects/d297e3933cee44408a03ee5029e09d51/groups/4e52c426e0ba483cbbb47c5d0093f5d2/roles/375d0d25eaa04686ba41303116106916 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:12.721891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.722679 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.722985 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.723291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.724139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:12.724563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:12.725966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:11:12.725966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: warnings.warn(msg) Oct 27 01:11:12.725966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: Oct 27 01:11:12.727374 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:12.742782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 131/268] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:11:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:12.748907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff811bde-e70f-4333-962c-4e38463e15ea admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.827996 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff811bde-e70f-4333-962c-4e38463e15ea admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.836177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e063a30-d985-460d-83bc-9a9b2a723e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.836854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e063a30-d985-460d-83bc-9a9b2a723e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.837136 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e063a30-d985-460d-83bc-9a9b2a723e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.837410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e063a30-d985-460d-83bc-9a9b2a723e5a admin admin] PATH_INFO: `/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.842972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e063a30-d985-460d-83bc-9a9b2a723e5a admin admin] RBAC: Authorizing `identity:get_group(group_id=4e52c426e0ba483cbbb47c5d0093f5d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:12.842972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-6e063a30-d985-460d-83bc-9a9b2a723e5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:11:12.842972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: warnings.warn(msg) Oct 27 01:11:12.842972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: Oct 27 01:11:12.842972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e063a30-d985-460d-83bc-9a9b2a723e5a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:12.844297 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 138/269] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Oct 27 01:11:12 2022] GET /identity/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2 => generated 226 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:12.849610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.860655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f758c72-c270-4101-b45f-363bfa2ae6a6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.867953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7aa20-c583-43a8-b6a8-4df3142a7fc1 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.868249 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7aa20-c583-43a8-b6a8-4df3142a7fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.868498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7aa20-c583-43a8-b6a8-4df3142a7fc1 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.868879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce8110-efa7-4b43-98bd-92317942eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.869628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce8110-efa7-4b43-98bd-92317942eb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.869912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce8110-efa7-4b43-98bd-92317942eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.870174 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 139/270] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:12.870335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce8110-efa7-4b43-98bd-92317942eb5c admin admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.872022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce8110-efa7-4b43-98bd-92317942eb5c admin admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:12.874313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce8110-efa7-4b43-98bd-92317942eb5c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:12.875641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fe1f-2988-45bb-a5fd-00e5ce8cebdf None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.875932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fe1f-2988-45bb-a5fd-00e5ce8cebdf None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.876209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fe1f-2988-45bb-a5fd-00e5ce8cebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.878451 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 132/271] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Oct 27 01:11:12 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:12.888605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce8110-efa7-4b43-98bd-92317942eb5c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.902320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce8110-efa7-4b43-98bd-92317942eb5c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:12.911574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c6c2fe1f-2988-45bb-a5fd-00e5ce8cebdf None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:12.912839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c6c2fe1f-2988-45bb-a5fd-00e5ce8cebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:12.915937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d908e-6473-4974-a3e0-c1b9fea9623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:12.916646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d908e-6473-4974-a3e0-c1b9fea9623a admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.916922 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d908e-6473-4974-a3e0-c1b9fea9623a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.917194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d908e-6473-4974-a3e0-c1b9fea9623a admin admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51/groups/4e52c426e0ba483cbbb47c5d0093f5d2/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.919262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d908e-6473-4974-a3e0-c1b9fea9623a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d297e3933cee44408a03ee5029e09d51, group_id=4e52c426e0ba483cbbb47c5d0093f5d2, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:12.920518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-7d7d908e-6473-4974-a3e0-c1b9fea9623a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:11:12.920518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: warnings.warn(msg) Oct 27 01:11:12.920518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: Oct 27 01:11:12.922944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d908e-6473-4974-a3e0-c1b9fea9623a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:12.930615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 140/272] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 27 01:11:12.935891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2fe1f-2988-45bb-a5fd-00e5ce8cebdf None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:12.952190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 133/273] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Oct 27 01:11:12 2022] PUT /identity/v3/projects/d297e3933cee44408a03ee5029e09d51/groups/4e52c426e0ba483cbbb47c5d0093f5d2/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:12.983723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa196423-cff0-4c56-8506-88e62538d2e5 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.984037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa196423-cff0-4c56-8506-88e62538d2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.984279 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa196423-cff0-4c56-8506-88e62538d2e5 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:12.987499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 134/274] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:11:12.994692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412eeef-8ef6-40b0-83a8-5fc36fbfe6e8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:12.995053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412eeef-8ef6-40b0-83a8-5fc36fbfe6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:12.995326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412eeef-8ef6-40b0-83a8-5fc36fbfe6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.027853 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6412eeef-8ef6-40b0-83a8-5fc36fbfe6e8 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:13.028435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6412eeef-8ef6-40b0-83a8-5fc36fbfe6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:13.123414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2fe1f-2988-45bb-a5fd-00e5ce8cebdf None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.152428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 135/275] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 01:11:13.200827 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee584c-f287-498e-94e6-3eca9c987add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.201914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee584c-f287-498e-94e6-3eca9c987add None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.202381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee584c-f287-498e-94e6-3eca9c987add None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.202879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee584c-f287-498e-94e6-3eca9c987add None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.216009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee584c-f287-498e-94e6-3eca9c987add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-86ee584c-f287-498e-94e6-3eca9c987add None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:13.221146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:13.221992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 01:11:13.222789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:13.225049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 141/276] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:13.231157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412eeef-8ef6-40b0-83a8-5fc36fbfe6e8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.377845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee584c-f287-498e-94e6-3eca9c987add None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.391125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:13.395043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412eeef-8ef6-40b0-83a8-5fc36fbfe6e8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.406572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:13.407835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee584c-f287-498e-94e6-3eca9c987add None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.419923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76789a3-82f8-4764-9d85-18a6372bbcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.420871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76789a3-82f8-4764-9d85-18a6372bbcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.421335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76789a3-82f8-4764-9d85-18a6372bbcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.421810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76789a3-82f8-4764-9d85-18a6372bbcc8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.443724 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1522-9d7a-4db9-9298-cedc9bfb3fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.444351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1522-9d7a-4db9-9298-cedc9bfb3fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.444629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1522-9d7a-4db9-9298-cedc9bfb3fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.444897 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1522-9d7a-4db9-9298-cedc9bfb3fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.445640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1522-9d7a-4db9-9298-cedc9bfb3fa8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:13.445944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1522-9d7a-4db9-9298-cedc9bfb3fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:13.447361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1522-9d7a-4db9-9298-cedc9bfb3fa8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:13.451318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76789a3-82f8-4764-9d85-18a6372bbcc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-d76789a3-82f8-4764-9d85-18a6372bbcc8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:13.456442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:13.457313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:13.458098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:13.460477 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 142/277] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:13.463989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 136/278] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:13.470607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76789a3-82f8-4764-9d85-18a6372bbcc8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.471716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1522-9d7a-4db9-9298-cedc9bfb3fa8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.486464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76789a3-82f8-4764-9d85-18a6372bbcc8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.496183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830bc57-eb02-455c-a4e8-36da7768eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.496956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830bc57-eb02-455c-a4e8-36da7768eb69 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.497352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830bc57-eb02-455c-a4e8-36da7768eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.497687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830bc57-eb02-455c-a4e8-36da7768eb69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.498467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830bc57-eb02-455c-a4e8-36da7768eb69 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:13.498967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830bc57-eb02-455c-a4e8-36da7768eb69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:13.500668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830bc57-eb02-455c-a4e8-36da7768eb69 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:13.521935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 143/279] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:13.532954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830bc57-eb02-455c-a4e8-36da7768eb69 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.553231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830bc57-eb02-455c-a4e8-36da7768eb69 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.561236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519db2-f7e2-44f3-bd4a-69291632fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.561891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519db2-f7e2-44f3-bd4a-69291632fdca admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.562167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519db2-f7e2-44f3-bd4a-69291632fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.562437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519db2-f7e2-44f3-bd4a-69291632fdca admin admin] PATH_INFO: `/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.567460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519db2-f7e2-44f3-bd4a-69291632fdca admin admin] RBAC: Authorizing `identity:get_group(group_id=4e52c426e0ba483cbbb47c5d0093f5d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:13.569419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519db2-f7e2-44f3-bd4a-69291632fdca admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:13.571270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 144/280] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:13.572078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519db2-f7e2-44f3-bd4a-69291632fdca admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.605193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519db2-f7e2-44f3-bd4a-69291632fdca admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.619689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65948ba1-a6cb-4183-b6fe-e7a730886ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.620355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948ba1-a6cb-4183-b6fe-e7a730886ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.620636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948ba1-a6cb-4183-b6fe-e7a730886ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.620913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948ba1-a6cb-4183-b6fe-e7a730886ffa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.635165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1522-9d7a-4db9-9298-cedc9bfb3fa8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.647936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65948ba1-a6cb-4183-b6fe-e7a730886ffa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-65948ba1-a6cb-4183-b6fe-e7a730886ffa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:13.655432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:13.656425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:13.657193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:13.658401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 145/281] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:13.659850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65948ba1-a6cb-4183-b6fe-e7a730886ffa admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.682801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65948ba1-a6cb-4183-b6fe-e7a730886ffa admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.689784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b04f66-efa8-4889-8501-8080147c287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.695155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b04f66-efa8-4889-8501-8080147c287a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.695527 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b04f66-efa8-4889-8501-8080147c287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.695809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b04f66-efa8-4889-8501-8080147c287a admin admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.698151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b04f66-efa8-4889-8501-8080147c287a admin admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:13.700264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b04f66-efa8-4889-8501-8080147c287a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:13.701958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 146/282] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:13.702764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b04f66-efa8-4889-8501-8080147c287a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.707569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfae46-170a-4ac4-a461-ac8c54d0db1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.708483 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfae46-170a-4ac4-a461-ac8c54d0db1d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.709014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfae46-170a-4ac4-a461-ac8c54d0db1d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.709502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfae46-170a-4ac4-a461-ac8c54d0db1d None admin] PATH_INFO: `/v3/users/fa7ceab58d4e4082a9fafab527352b49` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.710977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfae46-170a-4ac4-a461-ac8c54d0db1d None admin] RBAC: Authorizing `identity:get_user(user_id=fa7ceab58d4e4082a9fafab527352b49)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:13.712885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfae46-170a-4ac4-a461-ac8c54d0db1d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:13.715370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 137/283] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/users/fa7ceab58d4e4082a9fafab527352b49 => generated 293 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:13.717553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfae46-170a-4ac4-a461-ac8c54d0db1d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.722640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b04f66-efa8-4889-8501-8080147c287a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.728751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86409e-8780-483d-afaf-f8edfbd67480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.729373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86409e-8780-483d-afaf-f8edfbd67480 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.729658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86409e-8780-483d-afaf-f8edfbd67480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.730546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86409e-8780-483d-afaf-f8edfbd67480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.731268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86409e-8780-483d-afaf-f8edfbd67480 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:13.731571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86409e-8780-483d-afaf-f8edfbd67480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:13.734867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86409e-8780-483d-afaf-f8edfbd67480 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:13.736481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfae46-170a-4ac4-a461-ac8c54d0db1d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.745818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 147/284] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:13.746442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c5879-18c4-4565-8669-536a0ac56b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.746636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86409e-8780-483d-afaf-f8edfbd67480 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.747533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c5879-18c4-4565-8669-536a0ac56b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.748001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c5879-18c4-4565-8669-536a0ac56b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.748477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c5879-18c4-4565-8669-536a0ac56b4e admin admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3/groups/4e52c426e0ba483cbbb47c5d0093f5d2/roles/375d0d25eaa04686ba41303116106916` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.755511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c5879-18c4-4565-8669-536a0ac56b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6bde32c8f64180821a289d7647aab3, group_id=4e52c426e0ba483cbbb47c5d0093f5d2, role_id=375d0d25eaa04686ba41303116106916)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:13.758508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c5879-18c4-4565-8669-536a0ac56b4e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:13.786459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 138/285] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Oct 27 01:11:13 2022] PUT /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3/groups/4e52c426e0ba483cbbb47c5d0093f5d2/roles/375d0d25eaa04686ba41303116106916 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:13.787913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c5879-18c4-4565-8669-536a0ac56b4e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.871752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:13.939897 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c5879-18c4-4565-8669-536a0ac56b4e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.952168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1dcaa-de45-4e42-8343-22701c8419ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.952842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1dcaa-de45-4e42-8343-22701c8419ca admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:13.953264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1dcaa-de45-4e42-8343-22701c8419ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:13.953539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1dcaa-de45-4e42-8343-22701c8419ca admin admin] PATH_INFO: `/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:13.954663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1dcaa-de45-4e42-8343-22701c8419ca admin admin] RBAC: Authorizing `identity:get_group(group_id=4e52c426e0ba483cbbb47c5d0093f5d2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:13.956644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1dcaa-de45-4e42-8343-22701c8419ca admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:13.962473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 139/286] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:13.969329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1dcaa-de45-4e42-8343-22701c8419ca admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:13.982655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86409e-8780-483d-afaf-f8edfbd67480 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.987601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1dcaa-de45-4e42-8343-22701c8419ca admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:13.997944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8eb7c-582c-48e8-b639-83fe94067e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:13.999760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8eb7c-582c-48e8-b639-83fe94067e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:14.000051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8eb7c-582c-48e8-b639-83fe94067e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:14.000352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8eb7c-582c-48e8-b639-83fe94067e9e admin admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:14.002684 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8eb7c-582c-48e8-b639-83fe94067e9e admin admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:14.005838 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8eb7c-582c-48e8-b639-83fe94067e9e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:14.008142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 140/287] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:14.015001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8eb7c-582c-48e8-b639-83fe94067e9e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:14.028523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8eb7c-582c-48e8-b639-83fe94067e9e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:14.036064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdbb1c-7dab-462e-a928-616f0126df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:14.036824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdbb1c-7dab-462e-a928-616f0126df0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:14.037147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdbb1c-7dab-462e-a928-616f0126df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:14.037421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdbb1c-7dab-462e-a928-616f0126df0b admin admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3/groups/4e52c426e0ba483cbbb47c5d0093f5d2/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:14.039651 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdbb1c-7dab-462e-a928-616f0126df0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6bde32c8f64180821a289d7647aab3, group_id=4e52c426e0ba483cbbb47c5d0093f5d2, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:14.042753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdbb1c-7dab-462e-a928-616f0126df0b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:14.065292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424f430-ec4d-47ff-a823-7d70f2d3e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:14.066311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424f430-ec4d-47ff-a823-7d70f2d3e098 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:14.066595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424f430-ec4d-47ff-a823-7d70f2d3e098 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:14.066890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424f430-ec4d-47ff-a823-7d70f2d3e098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:14.067948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424f430-ec4d-47ff-a823-7d70f2d3e098 None admin] RBAC: Adding query filter params (role.id=8c10cd5042ab49e6a1276dd0450cc2f8, user.id=fa7ceab58d4e4082a9fafab527352b49, scope.system=all) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:14.068261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424f430-ec4d-47ff-a823-7d70f2d3e098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:14.069741 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424f430-ec4d-47ff-a823-7d70f2d3e098 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:14.071207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 141/288] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Oct 27 01:11:14 2022] PUT /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3/groups/4e52c426e0ba483cbbb47c5d0093f5d2/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:14.094675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 148/289] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Oct 27 01:11:13 2022] GET /identity/v3/role_assignments?user.id=fa7ceab58d4e4082a9fafab527352b49&scope.system=all&role.id=8c10cd5042ab49e6a1276dd0450cc2f8 => generated 510 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:14.446661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a18f1-870b-47ae-8b27-060e872b5523 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:14.447078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a18f1-870b-47ae-8b27-060e872b5523 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:14.447256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a18f1-870b-47ae-8b27-060e872b5523 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:14.448716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 142/290] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:14.454949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daffff8-f180-441c-b29a-7f2c35e3c2b2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:14.455226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daffff8-f180-441c-b29a-7f2c35e3c2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:14.455505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daffff8-f180-441c-b29a-7f2c35e3c2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:14.476304 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2daffff8-f180-441c-b29a-7f2c35e3c2b2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:14.477556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2daffff8-f180-441c-b29a-7f2c35e3c2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:14.482155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:14.543653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 149/291] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 01:11:14.821293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a18f1-870b-47ae-8b27-060e872b5523 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:14.845548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a18f1-870b-47ae-8b27-060e872b5523 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:14.850093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22459-9ee7-4874-9e16-6a3f3e5f65e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:14.850769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22459-9ee7-4874-9e16-6a3f3e5f65e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:14.851051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22459-9ee7-4874-9e16-6a3f3e5f65e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:14.851319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22459-9ee7-4874-9e16-6a3f3e5f65e6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:14.862513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a22459-9ee7-4874-9e16-6a3f3e5f65e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-13a22459-9ee7-4874-9e16-6a3f3e5f65e6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:14.868310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:14.869219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:14.870001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 143/292] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Oct 27 01:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:14.877259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daffff8-f180-441c-b29a-7f2c35e3c2b2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:14.888676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daffff8-f180-441c-b29a-7f2c35e3c2b2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:14.895784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad33ee-d182-48d0-8958-0d5c3d8d44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:14.895784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad33ee-d182-48d0-8958-0d5c3d8d44c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:14.895784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad33ee-d182-48d0-8958-0d5c3d8d44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:14.895784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad33ee-d182-48d0-8958-0d5c3d8d44c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:14.896828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad33ee-d182-48d0-8958-0d5c3d8d44c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:14.897321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad33ee-d182-48d0-8958-0d5c3d8d44c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:14.899192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad33ee-d182-48d0-8958-0d5c3d8d44c0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:14.909043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 150/293] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Oct 27 01:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:14.914351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22459-9ee7-4874-9e16-6a3f3e5f65e6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:14.927751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22459-9ee7-4874-9e16-6a3f3e5f65e6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:14.933496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc415-8e17-4c07-876a-90878e2cf25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:14.934140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc415-8e17-4c07-876a-90878e2cf25c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:14.934466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc415-8e17-4c07-876a-90878e2cf25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:14.934758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc415-8e17-4c07-876a-90878e2cf25c admin admin] PATH_INFO: `/v3/groups/47038789a23048faa598f38013a983b5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:14.942143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dc415-8e17-4c07-876a-90878e2cf25c admin admin] RBAC: Authorizing `identity:get_group(group_id=47038789a23048faa598f38013a983b5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:14.944207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dc415-8e17-4c07-876a-90878e2cf25c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:14.945969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 144/294] 10.222.0.23 () {56 vars in 1201 bytes} [Thu Oct 27 01:11:14 2022] GET /identity/v3/groups/47038789a23048faa598f38013a983b5 => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:14.951596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad33ee-d182-48d0-8958-0d5c3d8d44c0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:14.966737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad33ee-d182-48d0-8958-0d5c3d8d44c0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:14.971534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb120ef-48e1-400a-ba68-93b5a646ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:14.972396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb120ef-48e1-400a-ba68-93b5a646ba08 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:14.972978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb120ef-48e1-400a-ba68-93b5a646ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:14.973441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb120ef-48e1-400a-ba68-93b5a646ba08 admin admin] PATH_INFO: `/v3/projects/ab267813de0e4d19a617dbecdaeb9ab0` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:14.974803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb120ef-48e1-400a-ba68-93b5a646ba08 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab267813de0e4d19a617dbecdaeb9ab0)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:14.976883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb120ef-48e1-400a-ba68-93b5a646ba08 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:14.982818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 151/295] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Oct 27 01:11:14 2022] GET /identity/v3/projects/ab267813de0e4d19a617dbecdaeb9ab0 => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:14.984863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc415-8e17-4c07-876a-90878e2cf25c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:14.998243 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc415-8e17-4c07-876a-90878e2cf25c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:15.004480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b739-7845-4404-a504-b8d15a8a98c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:15.005211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b739-7845-4404-a504-b8d15a8a98c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:15.005486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b739-7845-4404-a504-b8d15a8a98c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:15.005801 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b739-7845-4404-a504-b8d15a8a98c2 admin admin] PATH_INFO: `/v3/projects/ab267813de0e4d19a617dbecdaeb9ab0/groups/47038789a23048faa598f38013a983b5/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:15.007928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b739-7845-4404-a504-b8d15a8a98c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab267813de0e4d19a617dbecdaeb9ab0, group_id=47038789a23048faa598f38013a983b5, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:15.010885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b739-7845-4404-a504-b8d15a8a98c2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:15.041249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 145/296] 10.222.0.23 () {58 vars in 1463 bytes} [Thu Oct 27 01:11:14 2022] PUT /identity/v3/projects/ab267813de0e4d19a617dbecdaeb9ab0/groups/47038789a23048faa598f38013a983b5/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:11:15.640470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea899e3a-13de-49a1-a6a2-adb8db25f116 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:15.641194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea899e3a-13de-49a1-a6a2-adb8db25f116 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:15.641672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea899e3a-13de-49a1-a6a2-adb8db25f116 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:15.643610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 152/297] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:15.656361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644dc7a-43ab-4f41-9625-f9161e45b771 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:15.656655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644dc7a-43ab-4f41-9625-f9161e45b771 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:15.656926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644dc7a-43ab-4f41-9625-f9161e45b771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:15.680300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e644dc7a-43ab-4f41-9625-f9161e45b771 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:15.681523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e644dc7a-43ab-4f41-9625-f9161e45b771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:15.783442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 146/298] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:15.995277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acde01-2bcc-47c4-afc9-5a5047e6c282 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:15.996258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acde01-2bcc-47c4-afc9-5a5047e6c282 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:15.996727 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acde01-2bcc-47c4-afc9-5a5047e6c282 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:15.998580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 153/299] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:16.003670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdb936-be04-4021-9a91-911d228e1f8e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:16.004064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdb936-be04-4021-9a91-911d228e1f8e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:16.004263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdb936-be04-4021-9a91-911d228e1f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:16.027767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-47cdb936-be04-4021-9a91-911d228e1f8e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:16.028977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-47cdb936-be04-4021-9a91-911d228e1f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:16.094497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:16.112932 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 147/300] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:16.144652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acde01-2bcc-47c4-afc9-5a5047e6c282 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:16.295501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acde01-2bcc-47c4-afc9-5a5047e6c282 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:16.353396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc253e4-3fbf-4f6e-b6d9-20d1f141dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:16.354114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc253e4-3fbf-4f6e-b6d9-20d1f141dff2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:16.354394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc253e4-3fbf-4f6e-b6d9-20d1f141dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:16.354662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc253e4-3fbf-4f6e-b6d9-20d1f141dff2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:16.375239 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:16.377151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc253e4-3fbf-4f6e-b6d9-20d1f141dff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-7dc253e4-3fbf-4f6e-b6d9-20d1f141dff2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:16.382640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:16.383701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:16.385072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 154/301] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:11:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:16.390219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdb936-be04-4021-9a91-911d228e1f8e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:16.539605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc253e4-3fbf-4f6e-b6d9-20d1f141dff2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:16.547710 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdb936-be04-4021-9a91-911d228e1f8e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:16.595604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21731f-1d6a-4a5e-a168-e4dca9170190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:16.596229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21731f-1d6a-4a5e-a168-e4dca9170190 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:16.596505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21731f-1d6a-4a5e-a168-e4dca9170190 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:16.596777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21731f-1d6a-4a5e-a168-e4dca9170190 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:16.597449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21731f-1d6a-4a5e-a168-e4dca9170190 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:16.597746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21731f-1d6a-4a5e-a168-e4dca9170190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:16.599134 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21731f-1d6a-4a5e-a168-e4dca9170190 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:16.616644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 148/302] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:16.638794 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21731f-1d6a-4a5e-a168-e4dca9170190 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:16.686689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc253e4-3fbf-4f6e-b6d9-20d1f141dff2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:16.716782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:16.743503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec5d5a-f9a2-4cc0-b610-554931e8d504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:16.744145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec5d5a-f9a2-4cc0-b610-554931e8d504 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:16.744431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec5d5a-f9a2-4cc0-b610-554931e8d504 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:16.744677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec5d5a-f9a2-4cc0-b610-554931e8d504 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:16.772120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec5d5a-f9a2-4cc0-b610-554931e8d504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-d1ec5d5a-f9a2-4cc0-b610-554931e8d504 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:16.777231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:16.778158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:16.779766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 155/303] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:16.784345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec5d5a-f9a2-4cc0-b610-554931e8d504 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:16.803359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21731f-1d6a-4a5e-a168-e4dca9170190 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:16.852354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac1e0-3756-461c-bca1-7f9c6c47b560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:16.852987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac1e0-3756-461c-bca1-7f9c6c47b560 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:16.853270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac1e0-3756-461c-bca1-7f9c6c47b560 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:16.853546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac1e0-3756-461c-bca1-7f9c6c47b560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:16.911656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:16.939332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac1e0-3756-461c-bca1-7f9c6c47b560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:16.941027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac1e0-3756-461c-bca1-7f9c6c47b560 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:16.961858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec5d5a-f9a2-4cc0-b610-554931e8d504 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:16.994595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:17.004538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605e8ee-e928-42e7-a9de-943640ac963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:17.005159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605e8ee-e928-42e7-a9de-943640ac963c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.005616 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605e8ee-e928-42e7-a9de-943640ac963c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.006024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605e8ee-e928-42e7-a9de-943640ac963c None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.006854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605e8ee-e928-42e7-a9de-943640ac963c None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:17.007290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605e8ee-e928-42e7-a9de-943640ac963c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:17.008984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605e8ee-e928-42e7-a9de-943640ac963c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:17.021021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 156/304] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:17.022422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50d464-46fb-476e-bd61-2792c585b657 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.027459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50d464-46fb-476e-bd61-2792c585b657 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.027916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50d464-46fb-476e-bd61-2792c585b657 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.029355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 157/305] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:17.030225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50d464-46fb-476e-bd61-2792c585b657 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:17.057543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 149/306] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 01:11:17.059432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674e47-58bb-408d-8ad2-cc51a022db79 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.059861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674e47-58bb-408d-8ad2-cc51a022db79 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.060338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674e47-58bb-408d-8ad2-cc51a022db79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.079204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-85674e47-58bb-408d-8ad2-cc51a022db79 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:17.080661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-85674e47-58bb-408d-8ad2-cc51a022db79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:17.145067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50d464-46fb-476e-bd61-2792c585b657 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:17.151881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 150/307] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:17.153022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674e47-58bb-408d-8ad2-cc51a022db79 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:17.169001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:17.181748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823471b7-55d6-4e99-819a-dbcc9e10be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:17.182596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823471b7-55d6-4e99-819a-dbcc9e10be23 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.183096 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823471b7-55d6-4e99-819a-dbcc9e10be23 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.183503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823471b7-55d6-4e99-819a-dbcc9e10be23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.240792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:17.257427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823471b7-55d6-4e99-819a-dbcc9e10be23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:17.259354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823471b7-55d6-4e99-819a-dbcc9e10be23 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:17.265935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674e47-58bb-408d-8ad2-cc51a022db79 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:17.305845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3de70-8d0e-4188-83fb-c07090d430d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:17.306911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3de70-8d0e-4188-83fb-c07090d430d2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.307761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3de70-8d0e-4188-83fb-c07090d430d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.308232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3de70-8d0e-4188-83fb-c07090d430d2 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.309579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3de70-8d0e-4188-83fb-c07090d430d2 None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:17.311325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3de70-8d0e-4188-83fb-c07090d430d2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:17.313174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 151/308] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:11:17 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:17.318820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3de70-8d0e-4188-83fb-c07090d430d2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:17.365327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 158/309] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:17.371219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823471b7-55d6-4e99-819a-dbcc9e10be23 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:17.396070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:17.433675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3de70-8d0e-4188-83fb-c07090d430d2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:17.471906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798ac79-0ae6-4143-9966-ca2824bcd425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:17.473054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798ac79-0ae6-4143-9966-ca2824bcd425 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.473548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798ac79-0ae6-4143-9966-ca2824bcd425 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.474128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798ac79-0ae6-4143-9966-ca2824bcd425 None admin] PATH_INFO: `/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.475611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798ac79-0ae6-4143-9966-ca2824bcd425 None admin] RBAC: Authorizing `identity:get_group(group_id=4e52c426e0ba483cbbb47c5d0093f5d2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:17.477308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798ac79-0ae6-4143-9966-ca2824bcd425 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:17.477654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823471b7-55d6-4e99-819a-dbcc9e10be23 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:17.479746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 152/310] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Oct 27 01:11:17 2022] GET /identity/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:17.481266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821868-8d23-4a37-a23d-5e29b02ce3cc None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.481733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821868-8d23-4a37-a23d-5e29b02ce3cc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.482180 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821868-8d23-4a37-a23d-5e29b02ce3cc None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.483642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 153/311] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:17.492215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad821868-8d23-4a37-a23d-5e29b02ce3cc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:17.511158 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:17.515253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e134c46-9255-4410-b01b-c807dddf3695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:17.516185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e134c46-9255-4410-b01b-c807dddf3695 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.516453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e134c46-9255-4410-b01b-c807dddf3695 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.516726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e134c46-9255-4410-b01b-c807dddf3695 None admin] PATH_INFO: `/v3/projects/d297e3933cee44408a03ee5029e09d51` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.517850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e134c46-9255-4410-b01b-c807dddf3695 None admin] RBAC: Authorizing `identity:get_project(project_id=d297e3933cee44408a03ee5029e09d51)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:17.519312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e134c46-9255-4410-b01b-c807dddf3695 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:17.520949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 159/312] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:11:17 2022] GET /identity/v3/projects/d297e3933cee44408a03ee5029e09d51 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:17.522055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218ac0-17ff-473a-9896-c46c0e566838 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.522331 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218ac0-17ff-473a-9896-c46c0e566838 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.522600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218ac0-17ff-473a-9896-c46c0e566838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.546235 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f6218ac0-17ff-473a-9896-c46c0e566838 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:17.547473 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f6218ac0-17ff-473a-9896-c46c0e566838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:17.610222 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad821868-8d23-4a37-a23d-5e29b02ce3cc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:17.620033 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 160/313] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:17.622287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218ac0-17ff-473a-9896-c46c0e566838 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:17.650233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:17.652057 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968f996-e367-4789-aadc-c62058c1ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:17.652929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968f996-e367-4789-aadc-c62058c1ce22 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.653276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968f996-e367-4789-aadc-c62058c1ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.653947 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968f996-e367-4789-aadc-c62058c1ce22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.654949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968f996-e367-4789-aadc-c62058c1ce22 None admin] RBAC: Adding query filter params (group.id=4e52c426e0ba483cbbb47c5d0093f5d2, role.id=375d0d25eaa04686ba41303116106916, scope.project.id=d297e3933cee44408a03ee5029e09d51) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:17.655477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968f996-e367-4789-aadc-c62058c1ce22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:17.657482 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968f996-e367-4789-aadc-c62058c1ce22 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:17.666296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 154/314] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Oct 27 01:11:17 2022] GET /identity/v3/role_assignments?group.id=4e52c426e0ba483cbbb47c5d0093f5d2&scope.project.id=d297e3933cee44408a03ee5029e09d51&role.id=375d0d25eaa04686ba41303116106916 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:17.667311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968f996-e367-4789-aadc-c62058c1ce22 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:17.801916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218ac0-17ff-473a-9896-c46c0e566838 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:17.846747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:17.879185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968f996-e367-4789-aadc-c62058c1ce22 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:17.908949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035542a6-f995-43ee-baf4-956d2d251fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:17.910056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035542a6-f995-43ee-baf4-956d2d251fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.910504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035542a6-f995-43ee-baf4-956d2d251fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.910940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035542a6-f995-43ee-baf4-956d2d251fb2 None admin] PATH_INFO: `/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.912776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035542a6-f995-43ee-baf4-956d2d251fb2 None admin] RBAC: Authorizing `identity:get_group(group_id=4e52c426e0ba483cbbb47c5d0093f5d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:17.914446 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035542a6-f995-43ee-baf4-956d2d251fb2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:17.916247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 161/315] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Oct 27 01:11:17 2022] GET /identity/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:17.919704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035542a6-f995-43ee-baf4-956d2d251fb2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:17.934615 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6a70-b8ec-471c-907f-78d543481d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:17.935456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6a70-b8ec-471c-907f-78d543481d1b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:17.935864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6a70-b8ec-471c-907f-78d543481d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:17.936210 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6a70-b8ec-471c-907f-78d543481d1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:17.953164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a6a70-b8ec-471c-907f-78d543481d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8d9a6a70-b8ec-471c-907f-78d543481d1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:17.960856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:17.961854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:17.962645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:17.964458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 155/316] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:17.964750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6a70-b8ec-471c-907f-78d543481d1b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:18.044680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:18.059026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035542a6-f995-43ee-baf4-956d2d251fb2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:18.100164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5d5f2-b987-42f8-b48c-4114a5698c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:18.100823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d5f2-b987-42f8-b48c-4114a5698c04 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.101101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d5f2-b987-42f8-b48c-4114a5698c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.101372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d5f2-b987-42f8-b48c-4114a5698c04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.111181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6a70-b8ec-471c-907f-78d543481d1b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:18.115621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5d5f2-b987-42f8-b48c-4114a5698c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-84c5d5f2-b987-42f8-b48c-4114a5698c04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:18.120578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:18.121437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:18.122205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 162/317] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:18.123357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5d5f2-b987-42f8-b48c-4114a5698c04 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:18.152270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc396636-2a40-439c-bb6b-3b44ef8c7661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:18.152270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc396636-2a40-439c-bb6b-3b44ef8c7661 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.152270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc396636-2a40-439c-bb6b-3b44ef8c7661 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.152576 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc396636-2a40-439c-bb6b-3b44ef8c7661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.153149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc396636-2a40-439c-bb6b-3b44ef8c7661 None admin] RBAC: Adding query filter params (group.id=4e52c426e0ba483cbbb47c5d0093f5d2, role.id=9145b5c6668a409d854e7d0c4491d775, scope.project.id=d297e3933cee44408a03ee5029e09d51) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:18.153453 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc396636-2a40-439c-bb6b-3b44ef8c7661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:18.154902 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc396636-2a40-439c-bb6b-3b44ef8c7661 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:18.162416 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 156/318] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Oct 27 01:11:17 2022] GET /identity/v3/role_assignments?group.id=4e52c426e0ba483cbbb47c5d0093f5d2&scope.project.id=d297e3933cee44408a03ee5029e09d51&role.id=9145b5c6668a409d854e7d0c4491d775 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:18.163665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca86359-833e-46ee-a735-31f16585f0de None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.163969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca86359-833e-46ee-a735-31f16585f0de None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.164249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca86359-833e-46ee-a735-31f16585f0de None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.165722 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 157/319] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:18.166308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca86359-833e-46ee-a735-31f16585f0de None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:18.169424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:18.265855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5d5f2-b987-42f8-b48c-4114a5698c04 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:18.307979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72b761-2b87-467f-8a69-3434a30fac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:18.308995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72b761-2b87-467f-8a69-3434a30fac61 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.309461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72b761-2b87-467f-8a69-3434a30fac61 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.309977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca86359-833e-46ee-a735-31f16585f0de None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:18.310187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72b761-2b87-467f-8a69-3434a30fac61 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.311182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72b761-2b87-467f-8a69-3434a30fac61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:18.311690 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72b761-2b87-467f-8a69-3434a30fac61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:18.315662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72b761-2b87-467f-8a69-3434a30fac61 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:18.327102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 163/320] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:18.329001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615accbd-6529-46c1-9ecf-df6a1d53d592 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.329525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615accbd-6529-46c1-9ecf-df6a1d53d592 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.329984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615accbd-6529-46c1-9ecf-df6a1d53d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.352750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-615accbd-6529-46c1-9ecf-df6a1d53d592 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:18.354141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-615accbd-6529-46c1-9ecf-df6a1d53d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:18.358919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:18.361654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43008c5c-f991-44af-bb22-fde5bd0a7bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:18.362660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43008c5c-f991-44af-bb22-fde5bd0a7bbc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.362660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43008c5c-f991-44af-bb22-fde5bd0a7bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.362660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43008c5c-f991-44af-bb22-fde5bd0a7bbc None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.363225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43008c5c-f991-44af-bb22-fde5bd0a7bbc None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:18.363548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43008c5c-f991-44af-bb22-fde5bd0a7bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:18.366410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43008c5c-f991-44af-bb22-fde5bd0a7bbc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:18.375871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 158/321] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:18.376554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43008c5c-f991-44af-bb22-fde5bd0a7bbc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:18.441562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 164/322] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:18.442683 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615accbd-6529-46c1-9ecf-df6a1d53d592 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:18.462129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:18.509002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43008c5c-f991-44af-bb22-fde5bd0a7bbc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:18.555219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615accbd-6529-46c1-9ecf-df6a1d53d592 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:18.556460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b712a-0380-43bb-bfa7-f05fd04b9522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:18.557326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b712a-0380-43bb-bfa7-f05fd04b9522 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.558418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b712a-0380-43bb-bfa7-f05fd04b9522 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.558702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b712a-0380-43bb-bfa7-f05fd04b9522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.596296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aab75f-aae2-4c8b-89f3-8032546a6afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:18.597218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aab75f-aae2-4c8b-89f3-8032546a6afe None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.597775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aab75f-aae2-4c8b-89f3-8032546a6afe None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.598053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aab75f-aae2-4c8b-89f3-8032546a6afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.614614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:18.648621 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b712a-0380-43bb-bfa7-f05fd04b9522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:18.650108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b712a-0380-43bb-bfa7-f05fd04b9522 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:18.697277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aab75f-aae2-4c8b-89f3-8032546a6afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:18.698816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aab75f-aae2-4c8b-89f3-8032546a6afe None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:18.724428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:18.768078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 159/323] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:18.768946 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b712a-0380-43bb-bfa7-f05fd04b9522 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:18.818357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 165/324] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:18.819579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aab75f-aae2-4c8b-89f3-8032546a6afe None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:18.870485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:18.892564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b712a-0380-43bb-bfa7-f05fd04b9522 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:18.933649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafed7f9-5fab-4243-84e9-d0209b5dc983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:18.934301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafed7f9-5fab-4243-84e9-d0209b5dc983 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.934572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafed7f9-5fab-4243-84e9-d0209b5dc983 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.936490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafed7f9-5fab-4243-84e9-d0209b5dc983 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.938541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aab75f-aae2-4c8b-89f3-8032546a6afe None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:18.947195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafed7f9-5fab-4243-84e9-d0209b5dc983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-eafed7f9-5fab-4243-84e9-d0209b5dc983 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:18.952445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:18.953326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:18.954115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 160/325] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:11:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:18.954796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafed7f9-5fab-4243-84e9-d0209b5dc983 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:18.979515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd38088-64e3-420f-a43d-18e3df1f5418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:18.980284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd38088-64e3-420f-a43d-18e3df1f5418 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.980403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd38088-64e3-420f-a43d-18e3df1f5418 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.980675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd38088-64e3-420f-a43d-18e3df1f5418 None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.981850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd38088-64e3-420f-a43d-18e3df1f5418 None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:18.983355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd38088-64e3-420f-a43d-18e3df1f5418 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:18.985195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 166/326] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:11:18 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:18.985518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:18.985804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd38088-64e3-420f-a43d-18e3df1f5418 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:19.071764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafed7f9-5fab-4243-84e9-d0209b5dc983 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:19.101190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd38088-64e3-420f-a43d-18e3df1f5418 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:19.110162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2840e-e050-4ec6-968a-f1fcff9cd86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:19.110834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2840e-e050-4ec6-968a-f1fcff9cd86b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:19.111108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2840e-e050-4ec6-968a-f1fcff9cd86b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:19.111373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2840e-e050-4ec6-968a-f1fcff9cd86b None admin] PATH_INFO: `/v3/projects/8f6bde32c8f64180821a289d7647aab3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:19.112533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2840e-e050-4ec6-968a-f1fcff9cd86b None admin] RBAC: Authorizing `identity:get_project(project_id=8f6bde32c8f64180821a289d7647aab3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:19.113002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:19.113972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2840e-e050-4ec6-968a-f1fcff9cd86b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:19.115728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 161/327] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:11:18 2022] GET /identity/v3/projects/8f6bde32c8f64180821a289d7647aab3 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:19.116385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2840e-e050-4ec6-968a-f1fcff9cd86b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:19.140730 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403d31f-4040-4f41-8604-80a2b7d3fd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:19.141338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403d31f-4040-4f41-8604-80a2b7d3fd19 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:19.141614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403d31f-4040-4f41-8604-80a2b7d3fd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:19.141880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403d31f-4040-4f41-8604-80a2b7d3fd19 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:19.142543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403d31f-4040-4f41-8604-80a2b7d3fd19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:19.142889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403d31f-4040-4f41-8604-80a2b7d3fd19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:19.144239 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403d31f-4040-4f41-8604-80a2b7d3fd19 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:19.152213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 167/328] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:19.153211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403d31f-4040-4f41-8604-80a2b7d3fd19 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:19.208646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:19.217579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2840e-e050-4ec6-968a-f1fcff9cd86b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:19.251750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf78ad-6fa4-4fa8-9499-ffae2ee61a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:19.252373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403d31f-4040-4f41-8604-80a2b7d3fd19 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:19.252476 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf78ad-6fa4-4fa8-9499-ffae2ee61a32 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:19.252650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf78ad-6fa4-4fa8-9499-ffae2ee61a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:19.252920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf78ad-6fa4-4fa8-9499-ffae2ee61a32 None admin] PATH_INFO: `/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:19.254012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf78ad-6fa4-4fa8-9499-ffae2ee61a32 None admin] RBAC: Authorizing `identity:get_group(group_id=4e52c426e0ba483cbbb47c5d0093f5d2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:19.255486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf78ad-6fa4-4fa8-9499-ffae2ee61a32 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:19.257070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 162/329] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Oct 27 01:11:19 2022] GET /identity/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:19.257962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf78ad-6fa4-4fa8-9499-ffae2ee61a32 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:19.288314 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272d23-486a-4816-be19-82ef45a9960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:19.289022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272d23-486a-4816-be19-82ef45a9960e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:19.289316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272d23-486a-4816-be19-82ef45a9960e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:19.289594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272d23-486a-4816-be19-82ef45a9960e None admin] PATH_INFO: `/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:19.290710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf272d23-486a-4816-be19-82ef45a9960e None admin] RBAC: Authorizing `identity:get_group(group_id=4e52c426e0ba483cbbb47c5d0093f5d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:19.292168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf272d23-486a-4816-be19-82ef45a9960e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:19.293758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 168/330] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Oct 27 01:11:19 2022] GET /identity/v3/groups/4e52c426e0ba483cbbb47c5d0093f5d2 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:19.294520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272d23-486a-4816-be19-82ef45a9960e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:19.334458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:19.358174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf78ad-6fa4-4fa8-9499-ffae2ee61a32 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:19.392276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a774348-59c2-468c-8171-e2ada35406bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:19.392517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272d23-486a-4816-be19-82ef45a9960e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:19.392874 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a774348-59c2-468c-8171-e2ada35406bd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:19.393152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a774348-59c2-468c-8171-e2ada35406bd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:19.393423 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a774348-59c2-468c-8171-e2ada35406bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:19.421529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:19.426474 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1ae8e-f560-41d2-bef4-d8e2b3c59503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:19.427110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1ae8e-f560-41d2-bef4-d8e2b3c59503 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:19.427387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1ae8e-f560-41d2-bef4-d8e2b3c59503 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:19.427665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1ae8e-f560-41d2-bef4-d8e2b3c59503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:19.428404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1ae8e-f560-41d2-bef4-d8e2b3c59503 None admin] RBAC: Adding query filter params (group.id=4e52c426e0ba483cbbb47c5d0093f5d2, role.id=375d0d25eaa04686ba41303116106916, scope.project.id=8f6bde32c8f64180821a289d7647aab3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:19.428712 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1ae8e-f560-41d2-bef4-d8e2b3c59503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:19.430129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1ae8e-f560-41d2-bef4-d8e2b3c59503 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:19.435913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 169/331] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Oct 27 01:11:19 2022] GET /identity/v3/role_assignments?group.id=4e52c426e0ba483cbbb47c5d0093f5d2&scope.project.id=8f6bde32c8f64180821a289d7647aab3&role.id=375d0d25eaa04686ba41303116106916 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:19.436771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1ae8e-f560-41d2-bef4-d8e2b3c59503 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:19.473848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a774348-59c2-468c-8171-e2ada35406bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:19.475716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a774348-59c2-468c-8171-e2ada35406bd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:19.549222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1ae8e-f560-41d2-bef4-d8e2b3c59503 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:19.550978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:19.590796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f8ce5-c00b-4791-85e6-dfe72af3d50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:19.591525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f8ce5-c00b-4791-85e6-dfe72af3d50b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:19.591709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f8ce5-c00b-4791-85e6-dfe72af3d50b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:19.591982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f8ce5-c00b-4791-85e6-dfe72af3d50b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:19.592733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f8ce5-c00b-4791-85e6-dfe72af3d50b None admin] RBAC: Adding query filter params (group.id=4e52c426e0ba483cbbb47c5d0093f5d2, role.id=9145b5c6668a409d854e7d0c4491d775, scope.project.id=8f6bde32c8f64180821a289d7647aab3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:19.593043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f8ce5-c00b-4791-85e6-dfe72af3d50b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:19.594494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f8ce5-c00b-4791-85e6-dfe72af3d50b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:19.600973 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 163/332] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:19.602031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a774348-59c2-468c-8171-e2ada35406bd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:19.606779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 170/333] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Oct 27 01:11:19 2022] GET /identity/v3/role_assignments?group.id=4e52c426e0ba483cbbb47c5d0093f5d2&scope.project.id=8f6bde32c8f64180821a289d7647aab3&role.id=9145b5c6668a409d854e7d0c4491d775 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:19.680301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:19.725660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a774348-59c2-468c-8171-e2ada35406bd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:19.763574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2a46c-b8d6-4e37-a2b2-21f075ac9410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:19.764225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2a46c-b8d6-4e37-a2b2-21f075ac9410 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:19.764504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2a46c-b8d6-4e37-a2b2-21f075ac9410 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:19.764748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2a46c-b8d6-4e37-a2b2-21f075ac9410 None admin] PATH_INFO: `/v3/projects/ab267813de0e4d19a617dbecdaeb9ab0` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:19.765962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2a46c-b8d6-4e37-a2b2-21f075ac9410 None admin] RBAC: Authorizing `identity:get_project(project_id=ab267813de0e4d19a617dbecdaeb9ab0)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:19.767452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2a46c-b8d6-4e37-a2b2-21f075ac9410 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:19.769125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 164/334] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:11:19 2022] GET /identity/v3/projects/ab267813de0e4d19a617dbecdaeb9ab0 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:19.775052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f8ce5-c00b-4791-85e6-dfe72af3d50b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:19.883174 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f8ce5-c00b-4791-85e6-dfe72af3d50b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:19.920639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83892450-39cc-41d6-91f0-9b05f931cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:19.921295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83892450-39cc-41d6-91f0-9b05f931cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:19.921583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83892450-39cc-41d6-91f0-9b05f931cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:19.921851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83892450-39cc-41d6-91f0-9b05f931cbe1 None admin] PATH_INFO: `/v3/groups/47038789a23048faa598f38013a983b5` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:19.922995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83892450-39cc-41d6-91f0-9b05f931cbe1 None admin] RBAC: Authorizing `identity:get_group(group_id=47038789a23048faa598f38013a983b5)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:19.924428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83892450-39cc-41d6-91f0-9b05f931cbe1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:19.926007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 171/335] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Oct 27 01:11:19 2022] GET /identity/v3/groups/47038789a23048faa598f38013a983b5 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:19.932120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2a46c-b8d6-4e37-a2b2-21f075ac9410 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:20.038389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2a46c-b8d6-4e37-a2b2-21f075ac9410 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:20.065451 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:20.073893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40034f-d9e6-4b2d-83db-d045c6df8a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:20.074508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40034f-d9e6-4b2d-83db-d045c6df8a40 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:20.074897 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40034f-d9e6-4b2d-83db-d045c6df8a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:20.075173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40034f-d9e6-4b2d-83db-d045c6df8a40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:20.075921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40034f-d9e6-4b2d-83db-d045c6df8a40 None admin] RBAC: Adding query filter params (group.id=47038789a23048faa598f38013a983b5, role.id=72129dcc28d546169fd012284e4019ec, scope.project.id=ab267813de0e4d19a617dbecdaeb9ab0) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:20.076230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40034f-d9e6-4b2d-83db-d045c6df8a40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:20.077665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40034f-d9e6-4b2d-83db-d045c6df8a40 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:20.085637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 165/336] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Oct 27 01:11:19 2022] GET /identity/v3/role_assignments?group.id=47038789a23048faa598f38013a983b5&scope.project.id=ab267813de0e4d19a617dbecdaeb9ab0&role.id=72129dcc28d546169fd012284e4019ec => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:22.711309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d5ec-aa65-4e13-b18c-3a5dda197fb2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:22.712049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d5ec-aa65-4e13-b18c-3a5dda197fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:22.712049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d5ec-aa65-4e13-b18c-3a5dda197fb2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:22.713514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 172/337] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:22.719143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3719cc-3a46-41ed-aceb-43f8be011f5d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:22.719588 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3719cc-3a46-41ed-aceb-43f8be011f5d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:22.719680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3719cc-3a46-41ed-aceb-43f8be011f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:22.748093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6f3719cc-3a46-41ed-aceb-43f8be011f5d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:22.749402 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6f3719cc-3a46-41ed-aceb-43f8be011f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:22.846294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 166/338] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:22.878003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23016-0e2b-49e7-a258-716166ad7576 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:22.878350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23016-0e2b-49e7-a258-716166ad7576 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:22.878560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23016-0e2b-49e7-a258-716166ad7576 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:22.880207 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 173/339] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:22.885365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5653c9-4bdb-447d-bab3-9738748c271b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:22.885658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5653c9-4bdb-447d-bab3-9738748c271b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:22.885938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5653c9-4bdb-447d-bab3-9738748c271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:22.915001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1b5653c9-4bdb-447d-bab3-9738748c271b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:22.916217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1b5653c9-4bdb-447d-bab3-9738748c271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:23.008500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 167/340] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:23.278612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23016-0e2b-49e7-a258-716166ad7576 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:23.289664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09792b-6edb-4f49-ba6e-7fc375816af4 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:23.290515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09792b-6edb-4f49-ba6e-7fc375816af4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:23.292581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09792b-6edb-4f49-ba6e-7fc375816af4 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:23.294630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 168/341] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:23.302761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090f7c-4036-4a4c-a9a0-2093b343e535 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:23.303037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090f7c-4036-4a4c-a9a0-2093b343e535 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:23.303306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090f7c-4036-4a4c-a9a0-2093b343e535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:23.336455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f8090f7c-4036-4a4c-a9a0-2093b343e535 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:23.338049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f8090f7c-4036-4a4c-a9a0-2093b343e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:23.344110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:23.397692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:23.419663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 169/342] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:23.420944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090f7c-4036-4a4c-a9a0-2093b343e535 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:23.435984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23016-0e2b-49e7-a258-716166ad7576 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:23.491972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcce0ae-4598-44fb-a4b6-c70539ce2a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:23.492623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcce0ae-4598-44fb-a4b6-c70539ce2a36 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:23.492901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcce0ae-4598-44fb-a4b6-c70539ce2a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:23.493222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcce0ae-4598-44fb-a4b6-c70539ce2a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:23.506207 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcce0ae-4598-44fb-a4b6-c70539ce2a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:23.507808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcce0ae-4598-44fb-a4b6-c70539ce2a36 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-abcce0ae-4598-44fb-a4b6-c70539ce2a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:23.525222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:23.526221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:23.527529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:23.527529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:23.527529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:23.527529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 174/343] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:23.527976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993b5d-52f7-4f98-8539-33f26364f8fa None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:23.528256 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993b5d-52f7-4f98-8539-33f26364f8fa None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:23.528525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993b5d-52f7-4f98-8539-33f26364f8fa None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:23.530042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 175/344] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:23.535177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71993b5d-52f7-4f98-8539-33f26364f8fa None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:23.550552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090f7c-4036-4a4c-a9a0-2093b343e535 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:23.586981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b1314-258f-4d7c-bcf7-f22d02a60955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:23.588129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1314-258f-4d7c-bcf7-f22d02a60955 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:23.588705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1314-258f-4d7c-bcf7-f22d02a60955 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:23.589219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1314-258f-4d7c-bcf7-f22d02a60955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:23.600418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b1314-258f-4d7c-bcf7-f22d02a60955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:23.602329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b1314-258f-4d7c-bcf7-f22d02a60955 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8d8b1314-258f-4d7c-bcf7-f22d02a60955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:23.619172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:23.620097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:23.620969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:23.620969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:23.620969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:23.622828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 170/345] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:23.624229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47197bf7-7854-4b49-a114-eb0f93d73b23 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:23.624715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47197bf7-7854-4b49-a114-eb0f93d73b23 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:23.625198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47197bf7-7854-4b49-a114-eb0f93d73b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:23.635270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:23.647697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-47197bf7-7854-4b49-a114-eb0f93d73b23 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:23.649427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-47197bf7-7854-4b49-a114-eb0f93d73b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:23.652971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71993b5d-52f7-4f98-8539-33f26364f8fa None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:23.678665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:23.689365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdde8f-8fa4-4d63-a72e-293db49e5e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:23.689981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdde8f-8fa4-4d63-a72e-293db49e5e76 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:23.690254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdde8f-8fa4-4d63-a72e-293db49e5e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:23.690512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdde8f-8fa4-4d63-a72e-293db49e5e76 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:23.691193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdde8f-8fa4-4d63-a72e-293db49e5e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:23.691495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdde8f-8fa4-4d63-a72e-293db49e5e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:23.692853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdde8f-8fa4-4d63-a72e-293db49e5e76 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:23.709374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 176/346] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:23.709374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdde8f-8fa4-4d63-a72e-293db49e5e76 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:23.730054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 171/347] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:23.731578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47197bf7-7854-4b49-a114-eb0f93d73b23 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:23.825566 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdde8f-8fa4-4d63-a72e-293db49e5e76 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:23.855926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47197bf7-7854-4b49-a114-eb0f93d73b23 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:23.874399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf7ee-7715-4df7-91dc-affc8a3b2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:23.875045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf7ee-7715-4df7-91dc-affc8a3b2210 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:23.875320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf7ee-7715-4df7-91dc-affc8a3b2210 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:23.875589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf7ee-7715-4df7-91dc-affc8a3b2210 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:23.876237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cf7ee-7715-4df7-91dc-affc8a3b2210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:23.876535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cf7ee-7715-4df7-91dc-affc8a3b2210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:23.877899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cf7ee-7715-4df7-91dc-affc8a3b2210 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:23.895978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 177/348] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:23.895978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf7ee-7715-4df7-91dc-affc8a3b2210 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:23.897887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564e576-d418-4ccc-9fda-b53e833a7944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:23.898847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e576-d418-4ccc-9fda-b53e833a7944 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:23.899315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e576-d418-4ccc-9fda-b53e833a7944 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:23.899826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e576-d418-4ccc-9fda-b53e833a7944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:23.901845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:23.912689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564e576-d418-4ccc-9fda-b53e833a7944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:23.914526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564e576-d418-4ccc-9fda-b53e833a7944 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3564e576-d418-4ccc-9fda-b53e833a7944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:23.930536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:23.931511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:23.932361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:23.932361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:23.932361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:23.934528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 172/349] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:23.935502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564e576-d418-4ccc-9fda-b53e833a7944 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:23.962251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:24.018633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf7ee-7715-4df7-91dc-affc8a3b2210 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:24.057940 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564e576-d418-4ccc-9fda-b53e833a7944 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:24.058151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca082-8fd8-4f95-af22-27af8189c9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:24.058580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca082-8fd8-4f95-af22-27af8189c9f9 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.058892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca082-8fd8-4f95-af22-27af8189c9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.059163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca082-8fd8-4f95-af22-27af8189c9f9 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.059818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ca082-8fd8-4f95-af22-27af8189c9f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:24.061243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ca082-8fd8-4f95-af22-27af8189c9f9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:24.091043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 178/350] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:11:23 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:24.092162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca082-8fd8-4f95-af22-27af8189c9f9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:24.103898 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6e067-ac8c-4b47-8a8e-da94084b2096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:24.104599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6e067-ac8c-4b47-8a8e-da94084b2096 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.104933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6e067-ac8c-4b47-8a8e-da94084b2096 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.105199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6e067-ac8c-4b47-8a8e-da94084b2096 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.105875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6e067-ac8c-4b47-8a8e-da94084b2096 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:24.107414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6e067-ac8c-4b47-8a8e-da94084b2096 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:24.131941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 173/351] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:11:23 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:24.132628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6e067-ac8c-4b47-8a8e-da94084b2096 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:24.181511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:24.231776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca082-8fd8-4f95-af22-27af8189c9f9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:24.246620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:24.280295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc625f66-d97d-4103-b3c3-cc5ba0e4b36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:24.281234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625f66-d97d-4103-b3c3-cc5ba0e4b36e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.281522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625f66-d97d-4103-b3c3-cc5ba0e4b36e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.281785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625f66-d97d-4103-b3c3-cc5ba0e4b36e None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.282452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc625f66-d97d-4103-b3c3-cc5ba0e4b36e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:24.282771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc625f66-d97d-4103-b3c3-cc5ba0e4b36e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:24.284165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc625f66-d97d-4103-b3c3-cc5ba0e4b36e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:24.291126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6e067-ac8c-4b47-8a8e-da94084b2096 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:24.299905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 179/352] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:24.301215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da492-b06b-43b0-a3e7-5f7761136e4e None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.301494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da492-b06b-43b0-a3e7-5f7761136e4e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.301763 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da492-b06b-43b0-a3e7-5f7761136e4e None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.303776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 180/353] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:24.308595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31da492-b06b-43b0-a3e7-5f7761136e4e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:24.334104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e4abf-98cb-45b7-aeae-977ac895e637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:24.334796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4abf-98cb-45b7-aeae-977ac895e637 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.335079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4abf-98cb-45b7-aeae-977ac895e637 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.335350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4abf-98cb-45b7-aeae-977ac895e637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.351144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e4abf-98cb-45b7-aeae-977ac895e637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:24.352783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e4abf-98cb-45b7-aeae-977ac895e637 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7e0e4abf-98cb-45b7-aeae-977ac895e637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:24.369442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:24.370382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:24.371253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:24.371253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:24.371253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:24.371253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 174/354] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:24.371774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c82699-6993-4635-8817-ecbb4ae3d7ae None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.372059 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c82699-6993-4635-8817-ecbb4ae3d7ae None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.372329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c82699-6993-4635-8817-ecbb4ae3d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.393509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-47c82699-6993-4635-8817-ecbb4ae3d7ae None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:24.394768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-47c82699-6993-4635-8817-ecbb4ae3d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:24.443890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31da492-b06b-43b0-a3e7-5f7761136e4e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:24.468741 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:24.482229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 175/355] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:24.489656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c82699-6993-4635-8817-ecbb4ae3d7ae None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:24.492642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991af61-6ce6-41fc-b309-af8f5ad3fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:24.493609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991af61-6ce6-41fc-b309-af8f5ad3fac7 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.494092 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991af61-6ce6-41fc-b309-af8f5ad3fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.494665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991af61-6ce6-41fc-b309-af8f5ad3fac7 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.495517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991af61-6ce6-41fc-b309-af8f5ad3fac7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:24.497150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991af61-6ce6-41fc-b309-af8f5ad3fac7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:24.530241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 181/356] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:11:24 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:24.605843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:24.672900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c82699-6993-4635-8817-ecbb4ae3d7ae None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:24.712432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad33ed-ff0e-463d-a525-911fac7f35ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:24.713345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad33ed-ff0e-463d-a525-911fac7f35ce None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.713791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad33ed-ff0e-463d-a525-911fac7f35ce None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.714203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad33ed-ff0e-463d-a525-911fac7f35ce None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.715100 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad33ed-ff0e-463d-a525-911fac7f35ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:24.715558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad33ed-ff0e-463d-a525-911fac7f35ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:24.717165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad33ed-ff0e-463d-a525-911fac7f35ce None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:24.730311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 176/357] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:24.739854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991af61-6ce6-41fc-b309-af8f5ad3fac7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:24.847236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991af61-6ce6-41fc-b309-af8f5ad3fac7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:24.880962 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36708a-8056-4e2a-8642-84252ccc4f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:24.881568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36708a-8056-4e2a-8642-84252ccc4f86 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.881846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36708a-8056-4e2a-8642-84252ccc4f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.882119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36708a-8056-4e2a-8642-84252ccc4f86 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.882851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36708a-8056-4e2a-8642-84252ccc4f86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:24.884328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36708a-8056-4e2a-8642-84252ccc4f86 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:24.893412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad33ed-ff0e-463d-a525-911fac7f35ce None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:24.922813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 182/358] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:11:24 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:25.020957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad33ed-ff0e-463d-a525-911fac7f35ce None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:25.037257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:25.072174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:25.072907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:25.073186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:25.073455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:25.074142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:25.075722 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:25.092629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.sql.core [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 01:11:25.092629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 01:11:25.092629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [parameters: {'id': 'e4325744fea94f819aff2eeb1dea7e8b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 01:11:25.092629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81615) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Oct 27 01:11:25.110672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return ref.to_dict() Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:11:25.111634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application yield resource Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise self.value Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application session.commit() Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 01:11:25.112561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.flush() Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application compat.raise_( Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 01:11:25.113408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:11:25.114287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:11:25.115288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [parameters: {'id': 'e4325744fea94f819aff2eeb1dea7e8b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:25.116797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 01:11:25.118594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:25.122211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 177/359] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Oct 27 01:11:24 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:25.122347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36708a-8056-4e2a-8642-84252ccc4f86 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:25.170955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:25.242787 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36708a-8056-4e2a-8642-84252ccc4f86 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:25.277907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0494-560f-4851-bf1e-1a9e34a29263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:25.278995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0494-560f-4851-bf1e-1a9e34a29263 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:25.279501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0494-560f-4851-bf1e-1a9e34a29263 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:25.279966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0494-560f-4851-bf1e-1a9e34a29263 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:25.297334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff0494-560f-4851-bf1e-1a9e34a29263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-aeff0494-560f-4851-bf1e-1a9e34a29263 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:25.302868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:25.303736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:25.304525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 183/360] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:11:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:25.310086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:25.438461 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca0c83-b4ba-4804-9256-728ee38d8d11 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:25.488331 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedc414-5568-4e05-ac49-c01f4d795a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:25.488967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedc414-5568-4e05-ac49-c01f4d795a2b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:25.489245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedc414-5568-4e05-ac49-c01f4d795a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:25.489515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedc414-5568-4e05-ac49-c01f4d795a2b None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:25.490189 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedc414-5568-4e05-ac49-c01f4d795a2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:25.490489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedc414-5568-4e05-ac49-c01f4d795a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:25.491893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedc414-5568-4e05-ac49-c01f4d795a2b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:25.502452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 178/361] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:26.538831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b7a8-8af7-460b-abaf-0800ab9e23ab None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:26.539391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b7a8-8af7-460b-abaf-0800ab9e23ab None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:26.539391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b7a8-8af7-460b-abaf-0800ab9e23ab None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:26.541012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 184/362] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:26.546567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80abbb4-6395-40ad-be2b-401b8cf5017c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:26.547000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80abbb4-6395-40ad-be2b-401b8cf5017c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:26.547194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80abbb4-6395-40ad-be2b-401b8cf5017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:26.575111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a80abbb4-6395-40ad-be2b-401b8cf5017c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:26.576306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a80abbb4-6395-40ad-be2b-401b8cf5017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:26.623245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:26.669340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 179/363] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:26.801343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99800-cafb-43a1-bcc4-a2f0942f89b8 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:26.801965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99800-cafb-43a1-bcc4-a2f0942f89b8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:26.802428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99800-cafb-43a1-bcc4-a2f0942f89b8 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:26.804278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 185/364] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:26.809737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6b91-7f85-4f5e-924f-60eb98d4b339 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:26.810260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6b91-7f85-4f5e-924f-60eb98d4b339 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:26.810791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6b91-7f85-4f5e-924f-60eb98d4b339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:26.836053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a64b6b91-7f85-4f5e-924f-60eb98d4b339 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:26.837576 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a64b6b91-7f85-4f5e-924f-60eb98d4b339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:26.928610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 180/365] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:27.070973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af513-f7dd-41c8-b238-a8e710405e1a None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.071346 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af513-f7dd-41c8-b238-a8e710405e1a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.071631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af513-f7dd-41c8-b238-a8e710405e1a None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.073348 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 186/366] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:27.078568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf39576-f1ac-467b-9fc9-314e17cdc8c9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.078906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf39576-f1ac-467b-9fc9-314e17cdc8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.079182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf39576-f1ac-467b-9fc9-314e17cdc8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.099360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bcf39576-f1ac-467b-9fc9-314e17cdc8c9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:27.100541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bcf39576-f1ac-467b-9fc9-314e17cdc8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:27.125669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1af513-f7dd-41c8-b238-a8e710405e1a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:27.199723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 181/367] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:27.267129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf39576-f1ac-467b-9fc9-314e17cdc8c9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:27.317815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:27.326431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1af513-f7dd-41c8-b238-a8e710405e1a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:27.331010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:27.384927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee866e6e-11dd-47e6-9084-f5e20f5f525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:27.385581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866e6e-11dd-47e6-9084-f5e20f5f525e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.385846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866e6e-11dd-47e6-9084-f5e20f5f525e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.386115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866e6e-11dd-47e6-9084-f5e20f5f525e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.405839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee866e6e-11dd-47e6-9084-f5e20f5f525e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ee866e6e-11dd-47e6-9084-f5e20f5f525e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:27.410795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:27.411672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:27.412540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:27.413144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 187/368] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:27.417839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee866e6e-11dd-47e6-9084-f5e20f5f525e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:27.454439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf39576-f1ac-467b-9fc9-314e17cdc8c9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:27.523271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d4c60-2f41-4253-ad13-469d0376de0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:27.524333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4c60-2f41-4253-ad13-469d0376de0d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.524836 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4c60-2f41-4253-ad13-469d0376de0d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.525310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4c60-2f41-4253-ad13-469d0376de0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.537333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d4c60-2f41-4253-ad13-469d0376de0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c73d4c60-2f41-4253-ad13-469d0376de0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:27.542582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:27.543503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:27.544271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:27.548728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 182/369] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:27.549589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d4c60-2f41-4253-ad13-469d0376de0d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:27.563102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee866e6e-11dd-47e6-9084-f5e20f5f525e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:27.599237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc7298-5f40-41ef-9a54-96329410d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:27.599780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7298-5f40-41ef-9a54-96329410d471 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.600217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7298-5f40-41ef-9a54-96329410d471 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.600489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7298-5f40-41ef-9a54-96329410d471 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.601564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc7298-5f40-41ef-9a54-96329410d471 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:27.601870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc7298-5f40-41ef-9a54-96329410d471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:27.603627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc7298-5f40-41ef-9a54-96329410d471 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:27.612965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 188/370] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:27.613935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc7298-5f40-41ef-9a54-96329410d471 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:27.633732 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:27.648847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:27.661167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d4c60-2f41-4253-ad13-469d0376de0d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:27.698237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea9f01-f972-4ec4-811e-060cc1c630c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:27.698907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea9f01-f972-4ec4-811e-060cc1c630c1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.699187 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea9f01-f972-4ec4-811e-060cc1c630c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.699457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea9f01-f972-4ec4-811e-060cc1c630c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.709588 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea9f01-f972-4ec4-811e-060cc1c630c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f8ea9f01-f972-4ec4-811e-060cc1c630c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:27.714503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:27.715583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 183/371] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:27.716380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea9f01-f972-4ec4-811e-060cc1c630c1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:27.728072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc7298-5f40-41ef-9a54-96329410d471 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:27.765598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3260502-77ec-45ff-b30b-075d33518e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:27.766359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3260502-77ec-45ff-b30b-075d33518e38 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.766640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3260502-77ec-45ff-b30b-075d33518e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.766940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3260502-77ec-45ff-b30b-075d33518e38 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.767762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3260502-77ec-45ff-b30b-075d33518e38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:27.768452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3260502-77ec-45ff-b30b-075d33518e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:27.770072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3260502-77ec-45ff-b30b-075d33518e38 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:27.778328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 189/372] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:27.779561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cce3b7-542c-4f24-81ee-59a26c60a616 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.779843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cce3b7-542c-4f24-81ee-59a26c60a616 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.780117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cce3b7-542c-4f24-81ee-59a26c60a616 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.781439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 190/373] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:27.781995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cce3b7-542c-4f24-81ee-59a26c60a616 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:27.830307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea9f01-f972-4ec4-811e-060cc1c630c1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:27.870935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571e62b-dba7-49fc-921b-c050923d546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:27.871514 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571e62b-dba7-49fc-921b-c050923d546a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.871793 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571e62b-dba7-49fc-921b-c050923d546a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.872066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571e62b-dba7-49fc-921b-c050923d546a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.873002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:27.882780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571e62b-dba7-49fc-921b-c050923d546a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:27.884302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571e62b-dba7-49fc-921b-c050923d546a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:27.897276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cce3b7-542c-4f24-81ee-59a26c60a616 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1571e62b-dba7-49fc-921b-c050923d546a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:27.899597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:27.900475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:27.901347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:27.901347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:27.901347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:27.901347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 184/374] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:27.901554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571e62b-dba7-49fc-921b-c050923d546a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:27.904389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:27.938193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158375e3-804c-4ace-87b2-1b04074ee781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:27.938854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158375e3-804c-4ace-87b2-1b04074ee781 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.939155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158375e3-804c-4ace-87b2-1b04074ee781 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.939511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158375e3-804c-4ace-87b2-1b04074ee781 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.940359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158375e3-804c-4ace-87b2-1b04074ee781 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:27.940668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158375e3-804c-4ace-87b2-1b04074ee781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:27.942182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158375e3-804c-4ace-87b2-1b04074ee781 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:27.955632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 191/375] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:27.957171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498193-fc38-4f5b-a6bd-f3bd00f97ae5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.957492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498193-fc38-4f5b-a6bd-f3bd00f97ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.957735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498193-fc38-4f5b-a6bd-f3bd00f97ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.976626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d9498193-fc38-4f5b-a6bd-f3bd00f97ae5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:27.977930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d9498193-fc38-4f5b-a6bd-f3bd00f97ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:28.007922 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571e62b-dba7-49fc-921b-c050923d546a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.043090 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8e5c7-293b-40c9-8c54-32901a5c2df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.043866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8e5c7-293b-40c9-8c54-32901a5c2df3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.044058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8e5c7-293b-40c9-8c54-32901a5c2df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.044329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8e5c7-293b-40c9-8c54-32901a5c2df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.049302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 192/376] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:28.050060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9498193-fc38-4f5b-a6bd-f3bd00f97ae5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.058826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8e5c7-293b-40c9-8c54-32901a5c2df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.058826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8e5c7-293b-40c9-8c54-32901a5c2df3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-2dc8e5c7-293b-40c9-8c54-32901a5c2df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:28.077297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:28.078285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:28.079157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:28.079157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:28.079157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:28.079157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 185/377] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:28.079558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8e5c7-293b-40c9-8c54-32901a5c2df3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.139617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:28.149142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:28.176962 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9498193-fc38-4f5b-a6bd-f3bd00f97ae5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.199056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8e5c7-293b-40c9-8c54-32901a5c2df3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.215971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c0a98-bed0-49e2-8798-d03ceaeb4469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.216717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c0a98-bed0-49e2-8798-d03ceaeb4469 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.217176 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c0a98-bed0-49e2-8798-d03ceaeb4469 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.217542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c0a98-bed0-49e2-8798-d03ceaeb4469 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.218414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c0a98-bed0-49e2-8798-d03ceaeb4469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:28.218839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c0a98-bed0-49e2-8798-d03ceaeb4469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.220371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c0a98-bed0-49e2-8798-d03ceaeb4469 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.234139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 193/378] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:28.236762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b90d0-c9ff-4a38-83ff-b9bd6e91f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.237573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b90d0-c9ff-4a38-83ff-b9bd6e91f836 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.237972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b90d0-c9ff-4a38-83ff-b9bd6e91f836 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.238384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b90d0-c9ff-4a38-83ff-b9bd6e91f836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.239395 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c0a98-bed0-49e2-8798-d03ceaeb4469 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.254163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b90d0-c9ff-4a38-83ff-b9bd6e91f836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.256237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b90d0-c9ff-4a38-83ff-b9bd6e91f836 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-271b90d0-c9ff-4a38-83ff-b9bd6e91f836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:28.272546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:28.273513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:28.274393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:28.274393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:28.274393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:28.276640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 186/379] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:28.277705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b90d0-c9ff-4a38-83ff-b9bd6e91f836 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.347562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c0a98-bed0-49e2-8798-d03ceaeb4469 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.376832 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:28.384601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78113f-d9fd-47d3-bc9d-a9b002772c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.385481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78113f-d9fd-47d3-bc9d-a9b002772c4d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.385830 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78113f-d9fd-47d3-bc9d-a9b002772c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.386106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78113f-d9fd-47d3-bc9d-a9b002772c4d None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.386798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78113f-d9fd-47d3-bc9d-a9b002772c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:28.387095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78113f-d9fd-47d3-bc9d-a9b002772c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.388845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78113f-d9fd-47d3-bc9d-a9b002772c4d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.390787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b90d0-c9ff-4a38-83ff-b9bd6e91f836 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.400156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:28.402048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 194/380] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:28.404743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78113f-d9fd-47d3-bc9d-a9b002772c4d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.429933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197445-a3e4-4497-bc7a-39459f432527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.430638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197445-a3e4-4497-bc7a-39459f432527 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.430957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197445-a3e4-4497-bc7a-39459f432527 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.431233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197445-a3e4-4497-bc7a-39459f432527 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.440613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197445-a3e4-4497-bc7a-39459f432527 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.442120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197445-a3e4-4497-bc7a-39459f432527 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9d197445-a3e4-4497-bc7a-39459f432527 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:28.456436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:28.457430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:28.458314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 187/381] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:28.458991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197445-a3e4-4497-bc7a-39459f432527 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.524085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78113f-d9fd-47d3-bc9d-a9b002772c4d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.562333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e40418-959c-49c4-97c4-dbc26e2bd2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.562971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e40418-959c-49c4-97c4-dbc26e2bd2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.563247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e40418-959c-49c4-97c4-dbc26e2bd2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.563783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e40418-959c-49c4-97c4-dbc26e2bd2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.563868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197445-a3e4-4497-bc7a-39459f432527 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.564204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e40418-959c-49c4-97c4-dbc26e2bd2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:28.564453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e40418-959c-49c4-97c4-dbc26e2bd2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.565815 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e40418-959c-49c4-97c4-dbc26e2bd2a3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.576811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 195/382] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:28.577646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e40418-959c-49c4-97c4-dbc26e2bd2a3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.598245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad139a0-bd12-43cc-ba62-d06bd728dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.598903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad139a0-bd12-43cc-ba62-d06bd728dc56 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.599182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad139a0-bd12-43cc-ba62-d06bd728dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.599454 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad139a0-bd12-43cc-ba62-d06bd728dc56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.609348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad139a0-bd12-43cc-ba62-d06bd728dc56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-cad139a0-bd12-43cc-ba62-d06bd728dc56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:28.614630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:28.615573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:28.616352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 188/383] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:28.617630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad139a0-bd12-43cc-ba62-d06bd728dc56 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.627558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:28.646492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:28.677307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e40418-959c-49c4-97c4-dbc26e2bd2a3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.708590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b638b-c929-4071-9dd2-9b9eaafd617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.709214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b638b-c929-4071-9dd2-9b9eaafd617d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.709488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b638b-c929-4071-9dd2-9b9eaafd617d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.709731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b638b-c929-4071-9dd2-9b9eaafd617d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.717018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b638b-c929-4071-9dd2-9b9eaafd617d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.718426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad139a0-bd12-43cc-ba62-d06bd728dc56 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.718561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b638b-c929-4071-9dd2-9b9eaafd617d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-7e9b638b-c929-4071-9dd2-9b9eaafd617d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:28.731024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:28.732071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:28.733044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 196/384] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:28.734407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df49806-9d3e-4e05-9398-751f164ad649 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.734691 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df49806-9d3e-4e05-9398-751f164ad649 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.734998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df49806-9d3e-4e05-9398-751f164ad649 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.736370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 197/385] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:28.736886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df49806-9d3e-4e05-9398-751f164ad649 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.757446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547141fa-5351-4c9d-9c25-e16ae683f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.758062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547141fa-5351-4c9d-9c25-e16ae683f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.758346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547141fa-5351-4c9d-9c25-e16ae683f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.758620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547141fa-5351-4c9d-9c25-e16ae683f9a7 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.759774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547141fa-5351-4c9d-9c25-e16ae683f9a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:28.759774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547141fa-5351-4c9d-9c25-e16ae683f9a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.761284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547141fa-5351-4c9d-9c25-e16ae683f9a7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.797846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 189/386] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:28.798912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547141fa-5351-4c9d-9c25-e16ae683f9a7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.840292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df49806-9d3e-4e05-9398-751f164ad649 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.851502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:28.875341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d59606-e29c-4d0a-a275-04d75d2a49e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.876005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d59606-e29c-4d0a-a275-04d75d2a49e6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.876269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d59606-e29c-4d0a-a275-04d75d2a49e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.876543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d59606-e29c-4d0a-a275-04d75d2a49e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.883306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:28.883923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d59606-e29c-4d0a-a275-04d75d2a49e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.885366 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d59606-e29c-4d0a-a275-04d75d2a49e6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-52d59606-e29c-4d0a-a275-04d75d2a49e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:28.897262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:28.898212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:28.899124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 198/387] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:28.900657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547141fa-5351-4c9d-9c25-e16ae683f9a7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:28.903723 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d59606-e29c-4d0a-a275-04d75d2a49e6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:28.934676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd003fe-a627-437b-a45f-313cca9dc9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:28.935324 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd003fe-a627-437b-a45f-313cca9dc9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.935601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd003fe-a627-437b-a45f-313cca9dc9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.935876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd003fe-a627-437b-a45f-313cca9dc9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.936545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd003fe-a627-437b-a45f-313cca9dc9c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:28.936845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd003fe-a627-437b-a45f-313cca9dc9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:28.938239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd003fe-a627-437b-a45f-313cca9dc9c0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:28.946025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 190/388] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:28.947317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4683-901a-4397-830c-364472849af5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:28.947606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4683-901a-4397-830c-364472849af5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:28.947888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4683-901a-4397-830c-364472849af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:28.965091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0a3d4683-901a-4397-830c-364472849af5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:28.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0a3d4683-901a-4397-830c-364472849af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:29.000637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d59606-e29c-4d0a-a275-04d75d2a49e6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.033072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 191/389] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:29.033659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf334edb-9598-4bf7-bc7d-594ca0b4c8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.033887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4683-901a-4397-830c-364472849af5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.034254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf334edb-9598-4bf7-bc7d-594ca0b4c8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.034528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf334edb-9598-4bf7-bc7d-594ca0b4c8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.034829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf334edb-9598-4bf7-bc7d-594ca0b4c8c6 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.035570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf334edb-9598-4bf7-bc7d-594ca0b4c8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:29.035872 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf334edb-9598-4bf7-bc7d-594ca0b4c8c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.037302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf334edb-9598-4bf7-bc7d-594ca0b4c8c6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.075921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 199/390] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Oct 27 01:11:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:29.079820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf334edb-9598-4bf7-bc7d-594ca0b4c8c6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.108036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:29.139416 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:29.164169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4683-901a-4397-830c-364472849af5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.185214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf334edb-9598-4bf7-bc7d-594ca0b4c8c6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.198295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae798147-69b7-46a4-989e-fea6a027e78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.198956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae798147-69b7-46a4-989e-fea6a027e78a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.199232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae798147-69b7-46a4-989e-fea6a027e78a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.199768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae798147-69b7-46a4-989e-fea6a027e78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.209780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae798147-69b7-46a4-989e-fea6a027e78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.211268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae798147-69b7-46a4-989e-fea6a027e78a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.220676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675553ca-e3b9-4784-aa83-bd68fd363e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.221283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675553ca-e3b9-4784-aa83-bd68fd363e14 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.221569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675553ca-e3b9-4784-aa83-bd68fd363e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.221830 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675553ca-e3b9-4784-aa83-bd68fd363e14 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.222559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675553ca-e3b9-4784-aa83-bd68fd363e14 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:29.222940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675553ca-e3b9-4784-aa83-bd68fd363e14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.224417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675553ca-e3b9-4784-aa83-bd68fd363e14 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ae798147-69b7-46a4-989e-fea6a027e78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:29.226504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:29.227471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:29.228343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:29.228343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.228343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:29.228343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 192/391] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:29.228554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae798147-69b7-46a4-989e-fea6a027e78a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.251210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 200/392] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:29.251210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675553ca-e3b9-4784-aa83-bd68fd363e14 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.332433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae798147-69b7-46a4-989e-fea6a027e78a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.335816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:29.351388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675553ca-e3b9-4784-aa83-bd68fd363e14 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.359839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:29.368335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f9896-6bba-49da-af6e-6e940840d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.368974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f9896-6bba-49da-af6e-6e940840d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.369263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f9896-6bba-49da-af6e-6e940840d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.369537 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f9896-6bba-49da-af6e-6e940840d5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.380034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f9896-6bba-49da-af6e-6e940840d5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.381511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f9896-6bba-49da-af6e-6e940840d5a5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.385579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b0779-d0f4-4eb2-823e-d439c52783aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.386206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b0779-d0f4-4eb2-823e-d439c52783aa None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.386480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b0779-d0f4-4eb2-823e-d439c52783aa None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.386761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b0779-d0f4-4eb2-823e-d439c52783aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-313f9896-6bba-49da-af6e-6e940840d5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:29.395893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:29.396803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:29.397630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:29.397630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.397630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:29.397630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 193/393] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:29.397841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f9896-6bba-49da-af6e-6e940840d5a5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.398935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b0779-d0f4-4eb2-823e-d439c52783aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.400512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b0779-d0f4-4eb2-823e-d439c52783aa None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-4c9b0779-d0f4-4eb2-823e-d439c52783aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:29.416019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:29.416892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:29.417722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:29.417722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.417722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:29.417722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 201/394] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:29.417941 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b0779-d0f4-4eb2-823e-d439c52783aa None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.504870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f9896-6bba-49da-af6e-6e940840d5a5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.516532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b0779-d0f4-4eb2-823e-d439c52783aa None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.538939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00255df0-be13-4034-9912-49544e24be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.539548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00255df0-be13-4034-9912-49544e24be92 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.539829 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00255df0-be13-4034-9912-49544e24be92 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.540122 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00255df0-be13-4034-9912-49544e24be92 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.540766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00255df0-be13-4034-9912-49544e24be92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:29.541072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00255df0-be13-4034-9912-49544e24be92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.542458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00255df0-be13-4034-9912-49544e24be92 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.550160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe017d-0a26-44e7-9322-7e57a13bc220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.550809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe017d-0a26-44e7-9322-7e57a13bc220 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.551075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe017d-0a26-44e7-9322-7e57a13bc220 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.551341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe017d-0a26-44e7-9322-7e57a13bc220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.554145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 194/395] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:29.554971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00255df0-be13-4034-9912-49544e24be92 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.558231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:29.562010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe017d-0a26-44e7-9322-7e57a13bc220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.564075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe017d-0a26-44e7-9322-7e57a13bc220 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a6fe017d-0a26-44e7-9322-7e57a13bc220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:29.579004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:29.580119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:29.581422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:29.581422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.581422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:29.581422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 202/396] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:29.581422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe017d-0a26-44e7-9322-7e57a13bc220 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.601542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:29.663278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00255df0-be13-4034-9912-49544e24be92 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.685577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe017d-0a26-44e7-9322-7e57a13bc220 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.697499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eb577-cb33-4e7d-9e62-c5daa0093b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.698133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eb577-cb33-4e7d-9e62-c5daa0093b69 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.698406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eb577-cb33-4e7d-9e62-c5daa0093b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.698663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eb577-cb33-4e7d-9e62-c5daa0093b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.708536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eb577-cb33-4e7d-9e62-c5daa0093b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.709983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eb577-cb33-4e7d-9e62-c5daa0093b69 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.718079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6d61a-5801-4a50-b126-a3358fb81de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.718684 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6d61a-5801-4a50-b126-a3358fb81de7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.719105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6d61a-5801-4a50-b126-a3358fb81de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.719384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6d61a-5801-4a50-b126-a3358fb81de7 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.720025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6d61a-5801-4a50-b126-a3358fb81de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:29.720328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6d61a-5801-4a50-b126-a3358fb81de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.721678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6d61a-5801-4a50-b126-a3358fb81de7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-425eb577-cb33-4e7d-9e62-c5daa0093b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:29.724316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:29.725179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:29.726010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:29.726010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:29.726010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:29.726010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 195/397] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:29.726219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eb577-cb33-4e7d-9e62-c5daa0093b69 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.735069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 203/398] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:29.735875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6d61a-5801-4a50-b126-a3358fb81de7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.785984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:29.816774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:29.826531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eb577-cb33-4e7d-9e62-c5daa0093b69 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.836913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6d61a-5801-4a50-b126-a3358fb81de7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.860904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce965cb1-afe1-4e4b-b9f6-b49089dfc716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.861516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce965cb1-afe1-4e4b-b9f6-b49089dfc716 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.861797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce965cb1-afe1-4e4b-b9f6-b49089dfc716 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.862227 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce965cb1-afe1-4e4b-b9f6-b49089dfc716 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.862912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce965cb1-afe1-4e4b-b9f6-b49089dfc716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:29.863214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce965cb1-afe1-4e4b-b9f6-b49089dfc716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.864601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce965cb1-afe1-4e4b-b9f6-b49089dfc716 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.872383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3c6fe-0be0-4e46-b9db-44b0b05d6b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:29.873017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c6fe-0be0-4e46-b9db-44b0b05d6b72 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:29.873729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c6fe-0be0-4e46-b9db-44b0b05d6b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:29.874000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c6fe-0be0-4e46-b9db-44b0b05d6b72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:29.876244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 196/399] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:29.880920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce965cb1-afe1-4e4b-b9f6-b49089dfc716 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.881008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3c6fe-0be0-4e46-b9db-44b0b05d6b72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:29.882386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3c6fe-0be0-4e46-b9db-44b0b05d6b72 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-afd3c6fe-0be0-4e46-b9db-44b0b05d6b72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:29.894465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:29.895493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 204/400] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:29.896316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3c6fe-0be0-4e46-b9db-44b0b05d6b72 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:29.984852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce965cb1-afe1-4e4b-b9f6-b49089dfc716 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:29.992040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3c6fe-0be0-4e46-b9db-44b0b05d6b72 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.002682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:30.017995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a697aa-c7ee-46be-a08a-d77c35f8deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.018607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a697aa-c7ee-46be-a08a-d77c35f8deee None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.018911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a697aa-c7ee-46be-a08a-d77c35f8deee None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.019182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a697aa-c7ee-46be-a08a-d77c35f8deee None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.019826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a697aa-c7ee-46be-a08a-d77c35f8deee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:30.020124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a697aa-c7ee-46be-a08a-d77c35f8deee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.021578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a697aa-c7ee-46be-a08a-d77c35f8deee None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.027336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dbf9b-51ca-4944-8b3b-d162964147d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.027945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dbf9b-51ca-4944-8b3b-d162964147d7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.028235 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dbf9b-51ca-4944-8b3b-d162964147d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.028504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dbf9b-51ca-4944-8b3b-d162964147d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.029138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dbf9b-51ca-4944-8b3b-d162964147d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:30.029431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dbf9b-51ca-4944-8b3b-d162964147d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.030800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dbf9b-51ca-4944-8b3b-d162964147d7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.032563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 197/401] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:30.033342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a697aa-c7ee-46be-a08a-d77c35f8deee None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.047612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:30.047755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 205/402] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:30.048458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dbf9b-51ca-4944-8b3b-d162964147d7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.136266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a697aa-c7ee-46be-a08a-d77c35f8deee None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.149365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dbf9b-51ca-4944-8b3b-d162964147d7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.171217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27c717-59df-45d1-8f53-040334098646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.171840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27c717-59df-45d1-8f53-040334098646 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.172112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27c717-59df-45d1-8f53-040334098646 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.172381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27c717-59df-45d1-8f53-040334098646 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.179733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27c717-59df-45d1-8f53-040334098646 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.181233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27c717-59df-45d1-8f53-040334098646 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.181924 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b6db4-a57d-4765-b8f4-308707e1490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.182555 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b6db4-a57d-4765-b8f4-308707e1490f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.182865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b6db4-a57d-4765-b8f4-308707e1490f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.183135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b6db4-a57d-4765-b8f4-308707e1490f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.189581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b6db4-a57d-4765-b8f4-308707e1490f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.191036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b6db4-a57d-4765-b8f4-308707e1490f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4f27c717-59df-45d1-8f53-040334098646 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:30.192259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:30.193127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:30.194014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 198/403] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:30.195499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27c717-59df-45d1-8f53-040334098646 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a16b6db4-a57d-4765-b8f4-308707e1490f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:30.202492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:30.203483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 206/404] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:30.204338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b6db4-a57d-4765-b8f4-308707e1490f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.233828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:30.268170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:30.299212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27c717-59df-45d1-8f53-040334098646 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.300909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b6db4-a57d-4765-b8f4-308707e1490f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.333026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9bb47-fead-45ce-86db-f58b5fa27a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.333655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9bb47-fead-45ce-86db-f58b5fa27a25 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.333829 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9bba6-f0cb-4e40-90eb-0bb56cdbe991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.333962 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9bb47-fead-45ce-86db-f58b5fa27a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.334178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9bb47-fead-45ce-86db-f58b5fa27a25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.334445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9bba6-f0cb-4e40-90eb-0bb56cdbe991 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.334742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9bba6-f0cb-4e40-90eb-0bb56cdbe991 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.335026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9bba6-f0cb-4e40-90eb-0bb56cdbe991 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.335724 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9bba6-f0cb-4e40-90eb-0bb56cdbe991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:30.336026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9bba6-f0cb-4e40-90eb-0bb56cdbe991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.337553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9bba6-f0cb-4e40-90eb-0bb56cdbe991 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.340813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9bb47-fead-45ce-86db-f58b5fa27a25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.342228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9bb47-fead-45ce-86db-f58b5fa27a25 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-20a9bb47-fead-45ce-86db-f58b5fa27a25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:30.354225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:30.355185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:30.356022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:30.356022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:30.356022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:30.356022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:30.356022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:30.356022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:30.356022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:30.356022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:30.356415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 199/405] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:30.356415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9bba6-f0cb-4e40-90eb-0bb56cdbe991 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.358865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 207/406] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:30.359799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9bb47-fead-45ce-86db-f58b5fa27a25 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.447333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:30.456444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9bba6-f0cb-4e40-90eb-0bb56cdbe991 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.458024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9bb47-fead-45ce-86db-f58b5fa27a25 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.486804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:30.491677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a648b-2ac8-4944-9e49-dcf9e9fa27ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.492281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a648b-2ac8-4944-9e49-dcf9e9fa27ae None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.492556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a648b-2ac8-4944-9e49-dcf9e9fa27ae None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.492819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a648b-2ac8-4944-9e49-dcf9e9fa27ae None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.492920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe08f21-5e05-4eb8-b94e-aad92d1229a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.493427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe08f21-5e05-4eb8-b94e-aad92d1229a3 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.493570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a648b-2ac8-4944-9e49-dcf9e9fa27ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:30.493707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe08f21-5e05-4eb8-b94e-aad92d1229a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.493874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a648b-2ac8-4944-9e49-dcf9e9fa27ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.493960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe08f21-5e05-4eb8-b94e-aad92d1229a3 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.494613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe08f21-5e05-4eb8-b94e-aad92d1229a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.495368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a648b-2ac8-4944-9e49-dcf9e9fa27ae None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.496110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe08f21-5e05-4eb8-b94e-aad92d1229a3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.517649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 208/407] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Oct 27 01:11:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:30.517649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a648b-2ac8-4944-9e49-dcf9e9fa27ae None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.518089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 200/408] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:11:30 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:30.518904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe08f21-5e05-4eb8-b94e-aad92d1229a3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.629954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a648b-2ac8-4944-9e49-dcf9e9fa27ae None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.649230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe08f21-5e05-4eb8-b94e-aad92d1229a3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.674691 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fdb7b-56ce-4885-9405-8bc7189e0453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.675342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fdb7b-56ce-4885-9405-8bc7189e0453 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.675635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fdb7b-56ce-4885-9405-8bc7189e0453 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.676208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fdb7b-56ce-4885-9405-8bc7189e0453 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.676621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fdb7b-56ce-4885-9405-8bc7189e0453 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:30.676920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fdb7b-56ce-4885-9405-8bc7189e0453 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.678396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fdb7b-56ce-4885-9405-8bc7189e0453 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.687773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f653294-4d8a-4e08-b0a3-d946ca7b1115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.688455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f653294-4d8a-4e08-b0a3-d946ca7b1115 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.688734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f653294-4d8a-4e08-b0a3-d946ca7b1115 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.689009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f653294-4d8a-4e08-b0a3-d946ca7b1115 None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/0ea18d542ca24e39ac758f34ad65e7bb/roles/70b64fc972514149806cf9aeb00c7ce1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.698513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 209/409] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:30.698895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fdb7b-56ce-4885-9405-8bc7189e0453 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.706310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f653294-4d8a-4e08-b0a3-d946ca7b1115 None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=0ea18d542ca24e39ac758f34ad65e7bb, role_id=70b64fc972514149806cf9aeb00c7ce1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.707814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f653294-4d8a-4e08-b0a3-d946ca7b1115 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.715021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:30.722142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 201/410] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:30 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/0ea18d542ca24e39ac758f34ad65e7bb/roles/70b64fc972514149806cf9aeb00c7ce1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:30.722893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f653294-4d8a-4e08-b0a3-d946ca7b1115 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.783799 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:30.848733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fdb7b-56ce-4885-9405-8bc7189e0453 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.866580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f653294-4d8a-4e08-b0a3-d946ca7b1115 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:30.886555 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a89c0-8e7b-46a6-9ba2-b738634b32c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.887639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a89c0-8e7b-46a6-9ba2-b738634b32c7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.887967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a89c0-8e7b-46a6-9ba2-b738634b32c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.888240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a89c0-8e7b-46a6-9ba2-b738634b32c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.888952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a89c0-8e7b-46a6-9ba2-b738634b32c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:30.889253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a89c0-8e7b-46a6-9ba2-b738634b32c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.890745 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a89c0-8e7b-46a6-9ba2-b738634b32c7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.907497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 210/411] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:30.907843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a89c0-8e7b-46a6-9ba2-b738634b32c7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.911244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c42eb-d5c8-4d2e-a014-ce3950033b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:30.912204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c42eb-d5c8-4d2e-a014-ce3950033b10 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.912624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c42eb-d5c8-4d2e-a014-ce3950033b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.913032 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c42eb-d5c8-4d2e-a014-ce3950033b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.924838 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c42eb-d5c8-4d2e-a014-ce3950033b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:30.926555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c42eb-d5c8-4d2e-a014-ce3950033b10 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d23c42eb-d5c8-4d2e-a014-ce3950033b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:30.942968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:30.944053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:30.945078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:30.945078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:30.945078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:30.946640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 202/412] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:30.947640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c42eb-d5c8-4d2e-a014-ce3950033b10 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:30.984404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:31.026548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a89c0-8e7b-46a6-9ba2-b738634b32c7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:31.060502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:31.062736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c598d16-9ed3-4e0b-975b-8ced7c19a1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:31.063526 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c598d16-9ed3-4e0b-975b-8ced7c19a1ef None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:31.063874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c598d16-9ed3-4e0b-975b-8ced7c19a1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:31.064214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c598d16-9ed3-4e0b-975b-8ced7c19a1ef None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/8af81f74f98b478ab71c0b22b365e3da/roles/70b64fc972514149806cf9aeb00c7ce1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:31.071587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c42eb-d5c8-4d2e-a014-ce3950033b10 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:31.081074 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c598d16-9ed3-4e0b-975b-8ced7c19a1ef None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=8af81f74f98b478ab71c0b22b365e3da, role_id=70b64fc972514149806cf9aeb00c7ce1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:31.082646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c598d16-9ed3-4e0b-975b-8ced7c19a1ef None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:31.098482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 211/413] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:30 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/8af81f74f98b478ab71c0b22b365e3da/roles/70b64fc972514149806cf9aeb00c7ce1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:31.099460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c598d16-9ed3-4e0b-975b-8ced7c19a1ef None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:31.124473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9fcf-ceb6-40e3-8132-cc2e9b51398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:31.125390 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9fcf-ceb6-40e3-8132-cc2e9b51398d None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:31.125787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9fcf-ceb6-40e3-8132-cc2e9b51398d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:31.126156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9fcf-ceb6-40e3-8132-cc2e9b51398d None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/095bc16a66c24f44939009ac95e2bc3f/roles/70b64fc972514149806cf9aeb00c7ce1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:31.154369 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be9fcf-ceb6-40e3-8132-cc2e9b51398d None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=095bc16a66c24f44939009ac95e2bc3f, role_id=70b64fc972514149806cf9aeb00c7ce1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:31.156183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be9fcf-ceb6-40e3-8132-cc2e9b51398d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:31.181488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 203/414] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:30 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/095bc16a66c24f44939009ac95e2bc3f/roles/70b64fc972514149806cf9aeb00c7ce1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:31.219501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c598d16-9ed3-4e0b-975b-8ced7c19a1ef None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:31.241012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:31.260677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b84ee-92f5-4c09-9e07-70513ca50c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:31.261382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b84ee-92f5-4c09-9e07-70513ca50c5b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:31.261666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b84ee-92f5-4c09-9e07-70513ca50c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:31.261938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b84ee-92f5-4c09-9e07-70513ca50c5b None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:31.263001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b84ee-92f5-4c09-9e07-70513ca50c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:31.263311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b84ee-92f5-4c09-9e07-70513ca50c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:31.264847 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b84ee-92f5-4c09-9e07-70513ca50c5b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:31.279172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 212/415] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:31.285461 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9fcf-ceb6-40e3-8132-cc2e9b51398d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:31.430775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9fcf-ceb6-40e3-8132-cc2e9b51398d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:31.469818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff4cd2-b58b-4aee-90c6-be239ecadfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:31.470473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4cd2-b58b-4aee-90c6-be239ecadfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:31.470821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4cd2-b58b-4aee-90c6-be239ecadfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:31.471056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4cd2-b58b-4aee-90c6-be239ecadfe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:31.478623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff4cd2-b58b-4aee-90c6-be239ecadfe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:31.480118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff4cd2-b58b-4aee-90c6-be239ecadfe8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:31.483193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0fff4cd2-b58b-4aee-90c6-be239ecadfe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:31.495735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:31.496807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:31.497644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:31.497644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:31.497644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:31.497644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:31.497644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:31.497644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:31.497644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:31.497644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:31.500225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 204/416] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:31.505888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b84ee-92f5-4c09-9e07-70513ca50c5b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:31.644455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b84ee-92f5-4c09-9e07-70513ca50c5b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:31.685950 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43f2c0-4bbf-4e75-b0fd-ecb05bf43ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:31.686547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43f2c0-4bbf-4e75-b0fd-ecb05bf43ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:31.686854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43f2c0-4bbf-4e75-b0fd-ecb05bf43ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:31.687132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43f2c0-4bbf-4e75-b0fd-ecb05bf43ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:31.687880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43f2c0-4bbf-4e75-b0fd-ecb05bf43ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:31.688188 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43f2c0-4bbf-4e75-b0fd-ecb05bf43ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:31.689631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43f2c0-4bbf-4e75-b0fd-ecb05bf43ce8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:31.707126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 213/417] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:31.713070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff4cd2-b58b-4aee-90c6-be239ecadfe8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:31.844676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff4cd2-b58b-4aee-90c6-be239ecadfe8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:31.892977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ff62e-1424-4276-adb3-3f8762bf5808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:31.893661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff62e-1424-4276-adb3-3f8762bf5808 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:31.893941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff62e-1424-4276-adb3-3f8762bf5808 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:31.894215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff62e-1424-4276-adb3-3f8762bf5808 None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/6ae71e9e597240ee88c6bd0754244aea/roles/70b64fc972514149806cf9aeb00c7ce1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:31.913524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ff62e-1424-4276-adb3-3f8762bf5808 None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=6ae71e9e597240ee88c6bd0754244aea, role_id=70b64fc972514149806cf9aeb00c7ce1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:31.915037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ff62e-1424-4276-adb3-3f8762bf5808 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:31.942895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 205/418] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:31 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/6ae71e9e597240ee88c6bd0754244aea/roles/70b64fc972514149806cf9aeb00c7ce1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:32.998389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ac56b-58f1-40db-b706-07ed129660bb None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:32.998389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ac56b-58f1-40db-b706-07ed129660bb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:32.998389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ac56b-58f1-40db-b706-07ed129660bb None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:32.999500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 214/419] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:33.003452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d71f-db2a-4078-b3b7-ecc7327f9d1a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:33.004230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d71f-db2a-4078-b3b7-ecc7327f9d1a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:33.004708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d71f-db2a-4078-b3b7-ecc7327f9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:33.024473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c9f2d71f-db2a-4078-b3b7-ecc7327f9d1a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:33.026009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9f2d71f-db2a-4078-b3b7-ecc7327f9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:33.078795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:33.102167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 206/420] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:33.164453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335c557-0600-43a4-9423-3fda02f649d4 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:33.165125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335c557-0600-43a4-9423-3fda02f649d4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:33.165588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335c557-0600-43a4-9423-3fda02f649d4 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:33.167150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 215/421] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:33.172553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33808-cefe-43ce-9ef8-7b03913e2140 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:33.173072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33808-cefe-43ce-9ef8-7b03913e2140 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:33.173549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba33808-cefe-43ce-9ef8-7b03913e2140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:33.192337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-dba33808-cefe-43ce-9ef8-7b03913e2140 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:33.193787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dba33808-cefe-43ce-9ef8-7b03913e2140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:33.260899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 207/422] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:33.395001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335c557-0600-43a4-9423-3fda02f649d4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:33.444820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:33.527330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335c557-0600-43a4-9423-3fda02f649d4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:33.573312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e81c25-801c-48c3-b355-5e14e4728d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:33.573956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e81c25-801c-48c3-b355-5e14e4728d7e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:33.574228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e81c25-801c-48c3-b355-5e14e4728d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:33.574504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e81c25-801c-48c3-b355-5e14e4728d7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:33.588367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e81c25-801c-48c3-b355-5e14e4728d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:33.592604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33808-cefe-43ce-9ef8-7b03913e2140 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c3e81c25-801c-48c3-b355-5e14e4728d7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:33.593220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:33.594062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:33.594868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 216/423] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:33.610413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e81c25-801c-48c3-b355-5e14e4728d7e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:33.743385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba33808-cefe-43ce-9ef8-7b03913e2140 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:33.764839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:33.800452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321f63b-a1a9-43f0-8392-f47155d2bd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:33.801130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321f63b-a1a9-43f0-8392-f47155d2bd59 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:33.801408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321f63b-a1a9-43f0-8392-f47155d2bd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:33.801675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321f63b-a1a9-43f0-8392-f47155d2bd59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:33.806263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:33.812361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e81c25-801c-48c3-b355-5e14e4728d7e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:33.827832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321f63b-a1a9-43f0-8392-f47155d2bd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4321f63b-a1a9-43f0-8392-f47155d2bd59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:33.833200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:33.834132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:33.834939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:33.843138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 208/424] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:33.849287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321f63b-a1a9-43f0-8392-f47155d2bd59 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:33.852518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef4db5-4a42-4e5d-ade1-b05df95334cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:33.853259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4db5-4a42-4e5d-ade1-b05df95334cc None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:33.853537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4db5-4a42-4e5d-ade1-b05df95334cc None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:33.853808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4db5-4a42-4e5d-ade1-b05df95334cc None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:33.854470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef4db5-4a42-4e5d-ade1-b05df95334cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:33.854798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef4db5-4a42-4e5d-ade1-b05df95334cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:33.856179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef4db5-4a42-4e5d-ade1-b05df95334cc None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:33.869761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 217/425] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:33.871049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef4db5-4a42-4e5d-ade1-b05df95334cc None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:33.998408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321f63b-a1a9-43f0-8392-f47155d2bd59 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.023923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef4db5-4a42-4e5d-ade1-b05df95334cc None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.044127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee5a0b-dbed-468b-9434-05414d92c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:34.044752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5a0b-dbed-468b-9434-05414d92c313 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.045040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5a0b-dbed-468b-9434-05414d92c313 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.045312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5a0b-dbed-468b-9434-05414d92c313 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.045986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee5a0b-dbed-468b-9434-05414d92c313 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:34.046285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee5a0b-dbed-468b-9434-05414d92c313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:34.048135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee5a0b-dbed-468b-9434-05414d92c313 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:34.056486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 209/426] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:34.057521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdd32d-15d3-428e-b19e-b7b1b2a5dc5a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.057801 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdd32d-15d3-428e-b19e-b7b1b2a5dc5a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.058071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdd32d-15d3-428e-b19e-b7b1b2a5dc5a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.063408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 210/427] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:34.064190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423367fa-07f5-41b8-83d0-e474880055bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:34.064405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13d8f5-3157-4e58-ba0c-d35d70777ff6 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.064683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13d8f5-3157-4e58-ba0c-d35d70777ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.064877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423367fa-07f5-41b8-83d0-e474880055bb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.064969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13d8f5-3157-4e58-ba0c-d35d70777ff6 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.065122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423367fa-07f5-41b8-83d0-e474880055bb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.065375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423367fa-07f5-41b8-83d0-e474880055bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.066245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 211/428] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:34.067230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13d8f5-3157-4e58-ba0c-d35d70777ff6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:34.077422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423367fa-07f5-41b8-83d0-e474880055bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:34.078985 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423367fa-07f5-41b8-83d0-e474880055bb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-423367fa-07f5-41b8-83d0-e474880055bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:34.094276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:34.095215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:34.096084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:34.096084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:34.096084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:34.096084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 218/429] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:34.097010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d52c8-035c-46f5-907b-b061ae25d1e1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.097010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d52c8-035c-46f5-907b-b061ae25d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.097198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d52c8-035c-46f5-907b-b061ae25d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.101239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:34.124327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-913d52c8-035c-46f5-907b-b061ae25d1e1 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:34.126026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-913d52c8-035c-46f5-907b-b061ae25d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:34.135456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:34.173695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13d8f5-3157-4e58-ba0c-d35d70777ff6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.201729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 219/430] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:34.203512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5484407-869d-4eb4-bbf1-02004256ca0f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.203816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5484407-869d-4eb4-bbf1-02004256ca0f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.204312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5484407-869d-4eb4-bbf1-02004256ca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.215437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581fa77-c17d-4e21-9fc0-6329da347414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:34.216712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581fa77-c17d-4e21-9fc0-6329da347414 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.217680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581fa77-c17d-4e21-9fc0-6329da347414 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.219067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581fa77-c17d-4e21-9fc0-6329da347414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.227963 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e5484407-869d-4eb4-bbf1-02004256ca0f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:34.229426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e5484407-869d-4eb4-bbf1-02004256ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:34.230011 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581fa77-c17d-4e21-9fc0-6329da347414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:34.231491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581fa77-c17d-4e21-9fc0-6329da347414 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e581fa77-c17d-4e21-9fc0-6329da347414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:34.246756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:34.247714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:34.248603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:34.248603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:34.248603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:34.248603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 212/431] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:34.249267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581fa77-c17d-4e21-9fc0-6329da347414 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:34.304501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 220/432] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:34.305843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5484407-869d-4eb4-bbf1-02004256ca0f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:34.407702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:34.416274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:34.445040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581fa77-c17d-4e21-9fc0-6329da347414 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.462158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5484407-869d-4eb4-bbf1-02004256ca0f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.494826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828267f-82ad-42e7-9b1b-b21cbcf26f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:34.495444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828267f-82ad-42e7-9b1b-b21cbcf26f8a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.495727 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828267f-82ad-42e7-9b1b-b21cbcf26f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.495997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828267f-82ad-42e7-9b1b-b21cbcf26f8a None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.496649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828267f-82ad-42e7-9b1b-b21cbcf26f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:34.496947 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828267f-82ad-42e7-9b1b-b21cbcf26f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:34.498318 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828267f-82ad-42e7-9b1b-b21cbcf26f8a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:34.506759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e931780-8371-4f4d-9e5b-f0c5a261833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:34.508070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e931780-8371-4f4d-9e5b-f0c5a261833d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.508672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e931780-8371-4f4d-9e5b-f0c5a261833d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.509179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e931780-8371-4f4d-9e5b-f0c5a261833d None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.509966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e931780-8371-4f4d-9e5b-f0c5a261833d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:34.510423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e931780-8371-4f4d-9e5b-f0c5a261833d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:34.515697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 213/433] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:34.515697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828267f-82ad-42e7-9b1b-b21cbcf26f8a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:34.515903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e931780-8371-4f4d-9e5b-f0c5a261833d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:34.527818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 221/434] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:34.528675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e931780-8371-4f4d-9e5b-f0c5a261833d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:34.631325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828267f-82ad-42e7-9b1b-b21cbcf26f8a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.636227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e931780-8371-4f4d-9e5b-f0c5a261833d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.667081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:34.668994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82674c-b8aa-4b83-991b-483e11e3db78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:34.669662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82674c-b8aa-4b83-991b-483e11e3db78 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.670009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82674c-b8aa-4b83-991b-483e11e3db78 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.670302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82674c-b8aa-4b83-991b-483e11e3db78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.673072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb39ed-0bc3-4d38-b221-710c00587631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:34.673731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb39ed-0bc3-4d38-b221-710c00587631 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.674003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb39ed-0bc3-4d38-b221-710c00587631 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.674272 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb39ed-0bc3-4d38-b221-710c00587631 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.682796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82674c-b8aa-4b83-991b-483e11e3db78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:34.683181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb39ed-0bc3-4d38-b221-710c00587631 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:34.684649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb39ed-0bc3-4d38-b221-710c00587631 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9a82674c-b8aa-4b83-991b-483e11e3db78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:34.687903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:34.688837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:34.689631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 214/435] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:34.690764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82674c-b8aa-4b83-991b-483e11e3db78 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:34.698429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-91eb39ed-0bc3-4d38-b221-710c00587631 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:34.702332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:34.703342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:34.704311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 222/436] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:11:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:34.704857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb39ed-0bc3-4d38-b221-710c00587631 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:34.806429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82674c-b8aa-4b83-991b-483e11e3db78 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.807785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb39ed-0bc3-4d38-b221-710c00587631 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.839478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fcaf6-e800-4532-a5b6-ce859d55954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:34.840116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fcaf6-e800-4532-a5b6-ce859d55954b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.840395 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fcaf6-e800-4532-a5b6-ce859d55954b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.840665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fcaf6-e800-4532-a5b6-ce859d55954b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.843712 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705978f-63a5-40de-8889-4cfae3fecbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:34.844344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705978f-63a5-40de-8889-4cfae3fecbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:34.844618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705978f-63a5-40de-8889-4cfae3fecbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:34.844888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705978f-63a5-40de-8889-4cfae3fecbd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:34.847877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fcaf6-e800-4532-a5b6-ce859d55954b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:34.849309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fcaf6-e800-4532-a5b6-ce859d55954b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:34.855108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705978f-63a5-40de-8889-4cfae3fecbd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-3705978f-63a5-40de-8889-4cfae3fecbd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:34.860926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:34.861983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:34.862938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-195fcaf6-e800-4532-a5b6-ce859d55954b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:34.863698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:34.864485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:11:34.865350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:34.865856 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 223/437] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:34.865920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 215/438] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:34.865983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705978f-63a5-40de-8889-4cfae3fecbd7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:34.866054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fcaf6-e800-4532-a5b6-ce859d55954b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:34.918572 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:34.929643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:34.965926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705978f-63a5-40de-8889-4cfae3fecbd7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:34.967094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fcaf6-e800-4532-a5b6-ce859d55954b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.000171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b259f-cb55-48fd-b991-78ecf7ec974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.000774 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b259f-cb55-48fd-b991-78ecf7ec974d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.000917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efd544-cb0e-4ce0-850c-c2b98c5c95dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.001017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b259f-cb55-48fd-b991-78ecf7ec974d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.001296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b259f-cb55-48fd-b991-78ecf7ec974d None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.001521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efd544-cb0e-4ce0-850c-c2b98c5c95dc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.001802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efd544-cb0e-4ce0-850c-c2b98c5c95dc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.001952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b259f-cb55-48fd-b991-78ecf7ec974d None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:35.002041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efd544-cb0e-4ce0-850c-c2b98c5c95dc None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.002255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b259f-cb55-48fd-b991-78ecf7ec974d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.002808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efd544-cb0e-4ce0-850c-c2b98c5c95dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:35.003115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efd544-cb0e-4ce0-850c-c2b98c5c95dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.003654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b259f-cb55-48fd-b991-78ecf7ec974d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.004528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efd544-cb0e-4ce0-850c-c2b98c5c95dc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.011560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 224/439] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:35.013129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff495a-8c9a-4be5-82e1-3acb346f3496 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.013430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff495a-8c9a-4be5-82e1-3acb346f3496 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.013702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff495a-8c9a-4be5-82e1-3acb346f3496 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.014890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 225/440] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:35.015577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff495a-8c9a-4be5-82e1-3acb346f3496 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.023030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 216/441] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Oct 27 01:11:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:35.024065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efd544-cb0e-4ce0-850c-c2b98c5c95dc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.123631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff495a-8c9a-4be5-82e1-3acb346f3496 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.124144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efd544-cb0e-4ce0-850c-c2b98c5c95dc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.136919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:35.146685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:35.158385 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd80d39-e3bf-4b49-bb36-dd7afa015b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.158557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df262e-2e8a-4023-8bef-ee869133e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.159024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd80d39-e3bf-4b49-bb36-dd7afa015b29 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.159139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df262e-2e8a-4023-8bef-ee869133e971 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.159299 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df262e-2e8a-4023-8bef-ee869133e971 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.159399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd80d39-e3bf-4b49-bb36-dd7afa015b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.159565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df262e-2e8a-4023-8bef-ee869133e971 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.159654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd80d39-e3bf-4b49-bb36-dd7afa015b29 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.160205 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df262e-2e8a-4023-8bef-ee869133e971 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:35.160296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd80d39-e3bf-4b49-bb36-dd7afa015b29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:35.160505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df262e-2e8a-4023-8bef-ee869133e971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.160593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd80d39-e3bf-4b49-bb36-dd7afa015b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.161858 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df262e-2e8a-4023-8bef-ee869133e971 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.161943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd80d39-e3bf-4b49-bb36-dd7afa015b29 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.169968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 217/442] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:35.170782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df262e-2e8a-4023-8bef-ee869133e971 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.183866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 226/443] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:35.185152 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cfcde-716a-4c04-b9c7-15f07738be60 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.185449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cfcde-716a-4c04-b9c7-15f07738be60 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.185744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cfcde-716a-4c04-b9c7-15f07738be60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.202921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-629cfcde-716a-4c04-b9c7-15f07738be60 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:35.204100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-629cfcde-716a-4c04-b9c7-15f07738be60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:35.268779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 227/444] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:35.269621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cfcde-716a-4c04-b9c7-15f07738be60 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.277525 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df262e-2e8a-4023-8bef-ee869133e971 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.312613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4176fd-b517-42ed-9cd8-802b822f5929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.313254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4176fd-b517-42ed-9cd8-802b822f5929 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.313534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4176fd-b517-42ed-9cd8-802b822f5929 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.313806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4176fd-b517-42ed-9cd8-802b822f5929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.325048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4176fd-b517-42ed-9cd8-802b822f5929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.326489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4176fd-b517-42ed-9cd8-802b822f5929 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0f4176fd-b517-42ed-9cd8-802b822f5929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:35.341044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:35.341920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:35.342782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:35.342782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:35.342782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:35.342782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 218/445] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:35.344709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4176fd-b517-42ed-9cd8-802b822f5929 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.369035 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cfcde-716a-4c04-b9c7-15f07738be60 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.370652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:35.382836 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:35.408047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37426b-331e-4f56-98ef-e3476eb031f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.408589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37426b-331e-4f56-98ef-e3476eb031f8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.408872 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37426b-331e-4f56-98ef-e3476eb031f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.409142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37426b-331e-4f56-98ef-e3476eb031f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.419564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37426b-331e-4f56-98ef-e3476eb031f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.420998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37426b-331e-4f56-98ef-e3476eb031f8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-1b37426b-331e-4f56-98ef-e3476eb031f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:35.436396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:35.437404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:35.438219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:35.438219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:35.438219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:35.438219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 228/446] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:35.438875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37426b-331e-4f56-98ef-e3476eb031f8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.455822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4176fd-b517-42ed-9cd8-802b822f5929 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.490488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadd81e-5f5a-4464-a0e3-1142d7c63abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.491204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadd81e-5f5a-4464-a0e3-1142d7c63abe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.491512 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadd81e-5f5a-4464-a0e3-1142d7c63abe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.491837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadd81e-5f5a-4464-a0e3-1142d7c63abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.502881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadd81e-5f5a-4464-a0e3-1142d7c63abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.504337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadd81e-5f5a-4464-a0e3-1142d7c63abe None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3eadd81e-5f5a-4464-a0e3-1142d7c63abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:35.519747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:35.520818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:35.526579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:35.526579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:35.526579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:35.526579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 219/447] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:35.526579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadd81e-5f5a-4464-a0e3-1142d7c63abe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.550850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37426b-331e-4f56-98ef-e3476eb031f8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.584109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5b0f7-9e3e-4726-88a4-ccf1d2aee1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.584724 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5b0f7-9e3e-4726-88a4-ccf1d2aee1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.584999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5b0f7-9e3e-4726-88a4-ccf1d2aee1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.585267 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5b0f7-9e3e-4726-88a4-ccf1d2aee1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.608032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:35.610550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:35.622491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadd81e-5f5a-4464-a0e3-1142d7c63abe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.651608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5b0f7-9e3e-4726-88a4-ccf1d2aee1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.652975 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5b0f7-9e3e-4726-88a4-ccf1d2aee1d0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.656966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ac0a-4d86-4568-aa0b-6c71a2c8b5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.657596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ac0a-4d86-4568-aa0b-6c71a2c8b5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.657873 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ac0a-4d86-4568-aa0b-6c71a2c8b5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.658140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ac0a-4d86-4568-aa0b-6c71a2c8b5f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.658805 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1ac0a-4d86-4568-aa0b-6c71a2c8b5f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:35.659106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1ac0a-4d86-4568-aa0b-6c71a2c8b5f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.660497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1ac0a-4d86-4568-aa0b-6c71a2c8b5f7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.672439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 220/448] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:35.673233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ac0a-4d86-4568-aa0b-6c71a2c8b5f7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.748218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 229/449] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:35.748218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5b0f7-9e3e-4726-88a4-ccf1d2aee1d0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.772131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ac0a-4d86-4568-aa0b-6c71a2c8b5f7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.801706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:35.805319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fffa5-b509-4d88-803e-c32827eaf19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.805934 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fffa5-b509-4d88-803e-c32827eaf19c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.806208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fffa5-b509-4d88-803e-c32827eaf19c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.806472 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fffa5-b509-4d88-803e-c32827eaf19c None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.807140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fffa5-b509-4d88-803e-c32827eaf19c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:35.807440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fffa5-b509-4d88-803e-c32827eaf19c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.808894 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fffa5-b509-4d88-803e-c32827eaf19c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.820397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 221/450] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:35.821356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fffa5-b509-4d88-803e-c32827eaf19c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.832113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:35.846510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5b0f7-9e3e-4726-88a4-ccf1d2aee1d0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.879364 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867161e-6177-4de7-b385-a2a77015ca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.879966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867161e-6177-4de7-b385-a2a77015ca7e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.880240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867161e-6177-4de7-b385-a2a77015ca7e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.880505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867161e-6177-4de7-b385-a2a77015ca7e None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.881150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867161e-6177-4de7-b385-a2a77015ca7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:35.881448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867161e-6177-4de7-b385-a2a77015ca7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.882833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867161e-6177-4de7-b385-a2a77015ca7e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.894021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 230/451] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:35.894833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867161e-6177-4de7-b385-a2a77015ca7e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.921124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fffa5-b509-4d88-803e-c32827eaf19c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.952931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4475e13-dbdd-4857-9944-dbcb164ee882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.953563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475e13-dbdd-4857-9944-dbcb164ee882 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.953842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475e13-dbdd-4857-9944-dbcb164ee882 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.954110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475e13-dbdd-4857-9944-dbcb164ee882 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.963936 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4475e13-dbdd-4857-9944-dbcb164ee882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b4475e13-dbdd-4857-9944-dbcb164ee882 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:35.969163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:35.970221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:35.971046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 222/452] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:35.971692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4475e13-dbdd-4857-9944-dbcb164ee882 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.998615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867161e-6177-4de7-b385-a2a77015ca7e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.012918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.033634 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc0968-ffaa-43a1-97df-9efb196165a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.034270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc0968-ffaa-43a1-97df-9efb196165a9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.034552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc0968-ffaa-43a1-97df-9efb196165a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.034858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc0968-ffaa-43a1-97df-9efb196165a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.035905 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.042424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc0968-ffaa-43a1-97df-9efb196165a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.043882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc0968-ffaa-43a1-97df-9efb196165a9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a7fc0968-ffaa-43a1-97df-9efb196165a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:36.055038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:36.056003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 231/453] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:36.056905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc0968-ffaa-43a1-97df-9efb196165a9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.069972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4475e13-dbdd-4857-9944-dbcb164ee882 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.103617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d8bb7-81dc-42ac-8c4d-926cb887ed57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.104230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d8bb7-81dc-42ac-8c4d-926cb887ed57 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.104528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d8bb7-81dc-42ac-8c4d-926cb887ed57 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.104768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d8bb7-81dc-42ac-8c4d-926cb887ed57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.115083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d8bb7-81dc-42ac-8c4d-926cb887ed57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.116531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d8bb7-81dc-42ac-8c4d-926cb887ed57 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-bb2d8bb7-81dc-42ac-8c4d-926cb887ed57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:36.130474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:36.131991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:36.132817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:36.132817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:36.132817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:36.132817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 223/454] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:36.132817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d8bb7-81dc-42ac-8c4d-926cb887ed57 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.160386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc0968-ffaa-43a1-97df-9efb196165a9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.193762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cca8f6-8a21-49cb-9cc8-5a532183befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.194324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cca8f6-8a21-49cb-9cc8-5a532183befc None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.194598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cca8f6-8a21-49cb-9cc8-5a532183befc None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.194895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cca8f6-8a21-49cb-9cc8-5a532183befc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.201257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cca8f6-8a21-49cb-9cc8-5a532183befc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.202795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cca8f6-8a21-49cb-9cc8-5a532183befc None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a9cca8f6-8a21-49cb-9cc8-5a532183befc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:36.213671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:36.214604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 232/455] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:36.215642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cca8f6-8a21-49cb-9cc8-5a532183befc None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.237041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d8bb7-81dc-42ac-8c4d-926cb887ed57 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.249753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.257479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.273240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3aaa8-bcd3-4f41-91b4-6141350861ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.273883 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3aaa8-bcd3-4f41-91b4-6141350861ff None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.274153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3aaa8-bcd3-4f41-91b4-6141350861ff None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.274497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3aaa8-bcd3-4f41-91b4-6141350861ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.281974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3aaa8-bcd3-4f41-91b4-6141350861ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.283547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3aaa8-bcd3-4f41-91b4-6141350861ff None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-fbb3aaa8-bcd3-4f41-91b4-6141350861ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:36.297131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:36.298044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:36.298984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 224/456] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:36.299821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3aaa8-bcd3-4f41-91b4-6141350861ff None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.318021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cca8f6-8a21-49cb-9cc8-5a532183befc None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.351057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f41e69-aea9-485d-8efd-c50a21514f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.351665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f41e69-aea9-485d-8efd-c50a21514f1b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.351940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f41e69-aea9-485d-8efd-c50a21514f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.352211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f41e69-aea9-485d-8efd-c50a21514f1b None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.352879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f41e69-aea9-485d-8efd-c50a21514f1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:36.353184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f41e69-aea9-485d-8efd-c50a21514f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.354547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f41e69-aea9-485d-8efd-c50a21514f1b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.362318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 233/457] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:36.363101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f41e69-aea9-485d-8efd-c50a21514f1b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.404501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3aaa8-bcd3-4f41-91b4-6141350861ff None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.436616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f0e84-ae35-4cd4-9f51-ab4e64de321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.437220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f0e84-ae35-4cd4-9f51-ab4e64de321d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.437494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f0e84-ae35-4cd4-9f51-ab4e64de321d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.437763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f0e84-ae35-4cd4-9f51-ab4e64de321d None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.438480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f0e84-ae35-4cd4-9f51-ab4e64de321d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:36.438830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f0e84-ae35-4cd4-9f51-ab4e64de321d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.440245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f0e84-ae35-4cd4-9f51-ab4e64de321d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.453676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.457424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 225/458] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:36.458376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f0e84-ae35-4cd4-9f51-ab4e64de321d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.459714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f41e69-aea9-485d-8efd-c50a21514f1b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.493886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170b73f-0c3a-452f-829f-0e7133b7cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.494494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170b73f-0c3a-452f-829f-0e7133b7cc9b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.494813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170b73f-0c3a-452f-829f-0e7133b7cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.495076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170b73f-0c3a-452f-829f-0e7133b7cc9b None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.495719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170b73f-0c3a-452f-829f-0e7133b7cc9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:36.496020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170b73f-0c3a-452f-829f-0e7133b7cc9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.496444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.497382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170b73f-0c3a-452f-829f-0e7133b7cc9b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.509003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 234/459] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:36.513980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170b73f-0c3a-452f-829f-0e7133b7cc9b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.559164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f0e84-ae35-4cd4-9f51-ab4e64de321d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.591923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df0b55-dea4-4939-9531-cda3be2b13a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.592526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df0b55-dea4-4939-9531-cda3be2b13a0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.592804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df0b55-dea4-4939-9531-cda3be2b13a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.593072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df0b55-dea4-4939-9531-cda3be2b13a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.593756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df0b55-dea4-4939-9531-cda3be2b13a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:36.594055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df0b55-dea4-4939-9531-cda3be2b13a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.595506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df0b55-dea4-4939-9531-cda3be2b13a0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.606768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 226/460] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:36.607147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170b73f-0c3a-452f-829f-0e7133b7cc9b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.607618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df0b55-dea4-4939-9531-cda3be2b13a0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.642730 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab976f5-a1b4-4515-8073-c0b18bf51d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.643369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab976f5-a1b4-4515-8073-c0b18bf51d14 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.643648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab976f5-a1b4-4515-8073-c0b18bf51d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.643921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab976f5-a1b4-4515-8073-c0b18bf51d14 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.644654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab976f5-a1b4-4515-8073-c0b18bf51d14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:36.644955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab976f5-a1b4-4515-8073-c0b18bf51d14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.646380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab976f5-a1b4-4515-8073-c0b18bf51d14 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.663088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 235/461] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:36.663863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab976f5-a1b4-4515-8073-c0b18bf51d14 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.677974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.709109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.713060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df0b55-dea4-4939-9531-cda3be2b13a0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.745538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797198d-e94a-48ba-98b9-fa9e2c14acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.746176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797198d-e94a-48ba-98b9-fa9e2c14acef None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.746481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797198d-e94a-48ba-98b9-fa9e2c14acef None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.746751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797198d-e94a-48ba-98b9-fa9e2c14acef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.757186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797198d-e94a-48ba-98b9-fa9e2c14acef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.758671 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797198d-e94a-48ba-98b9-fa9e2c14acef None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.761863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab976f5-a1b4-4515-8073-c0b18bf51d14 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-a797198d-e94a-48ba-98b9-fa9e2c14acef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:36.773184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:36.774257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:36.775130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:36.775130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:36.775130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:36.775130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 227/462] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:36.775610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797198d-e94a-48ba-98b9-fa9e2c14acef None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.799301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d796-891e-4511-aba1-dd94f2b925d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.799929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d796-891e-4511-aba1-dd94f2b925d0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.800192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d796-891e-4511-aba1-dd94f2b925d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.800461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d796-891e-4511-aba1-dd94f2b925d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.867106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d796-891e-4511-aba1-dd94f2b925d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.868663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d796-891e-4511-aba1-dd94f2b925d0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.874423 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797198d-e94a-48ba-98b9-fa9e2c14acef None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:36.882322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.907737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca6118-8e31-47a5-9b21-c0399b5a3e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:36.908363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca6118-8e31-47a5-9b21-c0399b5a3e5b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:36.908635 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca6118-8e31-47a5-9b21-c0399b5a3e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:36.908903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca6118-8e31-47a5-9b21-c0399b5a3e5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:36.915541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca6118-8e31-47a5-9b21-c0399b5a3e5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:36.916974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca6118-8e31-47a5-9b21-c0399b5a3e5b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ceca6118-8e31-47a5-9b21-c0399b5a3e5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:36.929120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:36.930145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 228/463] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:36.936135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca6118-8e31-47a5-9b21-c0399b5a3e5b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:36.948233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:36.965980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 236/464] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:36.966863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d796-891e-4511-aba1-dd94f2b925d0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.041603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca6118-8e31-47a5-9b21-c0399b5a3e5b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.063722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d796-891e-4511-aba1-dd94f2b925d0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.073852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae28b1e-ea3c-4484-8377-643dca248f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.074605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae28b1e-ea3c-4484-8377-643dca248f9a None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.074911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae28b1e-ea3c-4484-8377-643dca248f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.075184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae28b1e-ea3c-4484-8377-643dca248f9a None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/b38639ab90e5439a990cf603c627dab3/roles/70b64fc972514149806cf9aeb00c7ce1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.077362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:37.089769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae28b1e-ea3c-4484-8377-643dca248f9a None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=b38639ab90e5439a990cf603c627dab3, role_id=70b64fc972514149806cf9aeb00c7ce1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.091260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae28b1e-ea3c-4484-8377-643dca248f9a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.097647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd644-6598-4514-8fba-f5bb91c7dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.098380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd644-6598-4514-8fba-f5bb91c7dddb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.098656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd644-6598-4514-8fba-f5bb91c7dddb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.098955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd644-6598-4514-8fba-f5bb91c7dddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.104289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 229/465] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:36 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/b38639ab90e5439a990cf603c627dab3/roles/70b64fc972514149806cf9aeb00c7ce1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:37.104871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae28b1e-ea3c-4484-8377-643dca248f9a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.176125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bd644-6598-4514-8fba-f5bb91c7dddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.177614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bd644-6598-4514-8fba-f5bb91c7dddb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.186145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:37.232933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae28b1e-ea3c-4484-8377-643dca248f9a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.270505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607128c-28fe-4ffa-ab47-091542e5a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.271253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607128c-28fe-4ffa-ab47-091542e5a24c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.271535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607128c-28fe-4ffa-ab47-091542e5a24c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.271809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607128c-28fe-4ffa-ab47-091542e5a24c None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.272464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607128c-28fe-4ffa-ab47-091542e5a24c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:37.272772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607128c-28fe-4ffa-ab47-091542e5a24c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.274172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607128c-28fe-4ffa-ab47-091542e5a24c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.286518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 230/466] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:37.287627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607128c-28fe-4ffa-ab47-091542e5a24c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.299912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 237/467] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:37.300770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd644-6598-4514-8fba-f5bb91c7dddb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.316321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:37.393706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607128c-28fe-4ffa-ab47-091542e5a24c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.408276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd644-6598-4514-8fba-f5bb91c7dddb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.413574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:37.428152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440a75e-e695-4ef0-a72f-94c8f1e9bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.428759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a75e-e695-4ef0-a72f-94c8f1e9bab8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.429051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a75e-e695-4ef0-a72f-94c8f1e9bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.429315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440a75e-e695-4ef0-a72f-94c8f1e9bab8 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.430006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440a75e-e695-4ef0-a72f-94c8f1e9bab8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:37.430307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440a75e-e695-4ef0-a72f-94c8f1e9bab8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.431790 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440a75e-e695-4ef0-a72f-94c8f1e9bab8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.443563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 231/468] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:37.444375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440a75e-e695-4ef0-a72f-94c8f1e9bab8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.451607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33acbc2-ce06-4d67-9865-9d909be6d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.452259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33acbc2-ce06-4d67-9865-9d909be6d289 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.452540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33acbc2-ce06-4d67-9865-9d909be6d289 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.452812 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33acbc2-ce06-4d67-9865-9d909be6d289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.465768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33acbc2-ce06-4d67-9865-9d909be6d289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.467259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33acbc2-ce06-4d67-9865-9d909be6d289 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-d33acbc2-ce06-4d67-9865-9d909be6d289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:37.482707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:37.483716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:37.489624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:37.489624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:37.489624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:37.489624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 238/469] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:37.489624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33acbc2-ce06-4d67-9865-9d909be6d289 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.550199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440a75e-e695-4ef0-a72f-94c8f1e9bab8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.560037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:37.586890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d8cb9-590f-41d5-af65-98048a8a28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.587536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8cb9-590f-41d5-af65-98048a8a28ca None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.587799 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8cb9-590f-41d5-af65-98048a8a28ca None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.588068 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8cb9-590f-41d5-af65-98048a8a28ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.595335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d8cb9-590f-41d5-af65-98048a8a28ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.596781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d8cb9-590f-41d5-af65-98048a8a28ca None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.601072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33acbc2-ce06-4d67-9865-9d909be6d289 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6c2d8cb9-590f-41d5-af65-98048a8a28ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:37.608754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:37.609646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 232/470] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:37.615429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d8cb9-590f-41d5-af65-98048a8a28ca None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.638753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72c172-bfdb-49e3-a50a-f6d4d925da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.639426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72c172-bfdb-49e3-a50a-f6d4d925da44 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.639705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72c172-bfdb-49e3-a50a-f6d4d925da44 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.639972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72c172-bfdb-49e3-a50a-f6d4d925da44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.651286 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72c172-bfdb-49e3-a50a-f6d4d925da44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.652737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72c172-bfdb-49e3-a50a-f6d4d925da44 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.656123 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-7a72c172-bfdb-49e3-a50a-f6d4d925da44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:37.668839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:37.669753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:37.671193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:37.671193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:37.671193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:37.671193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 239/471] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:37.671642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72c172-bfdb-49e3-a50a-f6d4d925da44 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.722562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d8cb9-590f-41d5-af65-98048a8a28ca None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.756250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fc817-068d-4a4d-a9d0-d9c01ee6730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.756779 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fc817-068d-4a4d-a9d0-d9c01ee6730c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.757051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fc817-068d-4a4d-a9d0-d9c01ee6730c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.757321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fc817-068d-4a4d-a9d0-d9c01ee6730c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.758038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fc817-068d-4a4d-a9d0-d9c01ee6730c None admin] RBAC: Adding query filter params (role.id=70b64fc972514149806cf9aeb00c7ce1, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=0ea18d542ca24e39ac758f34ad65e7bb) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:37.758341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fc817-068d-4a4d-a9d0-d9c01ee6730c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.759829 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fc817-068d-4a4d-a9d0-d9c01ee6730c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.766040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 233/472] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/role_assignments?user.id=0ea18d542ca24e39ac758f34ad65e7bb&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=70b64fc972514149806cf9aeb00c7ce1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:37.766847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fc817-068d-4a4d-a9d0-d9c01ee6730c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.790360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72c172-bfdb-49e3-a50a-f6d4d925da44 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.814518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:37.846339 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762e83-447b-4b90-aec6-8e7ef93f8fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.847017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762e83-447b-4b90-aec6-8e7ef93f8fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.847292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762e83-447b-4b90-aec6-8e7ef93f8fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.847561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762e83-447b-4b90-aec6-8e7ef93f8fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.848243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762e83-447b-4b90-aec6-8e7ef93f8fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:37.848536 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762e83-447b-4b90-aec6-8e7ef93f8fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.850368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762e83-447b-4b90-aec6-8e7ef93f8fd1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.870767 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 240/473] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:37.870767 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762e83-447b-4b90-aec6-8e7ef93f8fd1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.905482 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fc817-068d-4a4d-a9d0-d9c01ee6730c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:37.909923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:37.952756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d3615-d92d-45b4-b123-860819f262e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:37.953361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d3615-d92d-45b4-b123-860819f262e2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:37.953638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d3615-d92d-45b4-b123-860819f262e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:37.953950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d3615-d92d-45b4-b123-860819f262e2 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:37.954699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d3615-d92d-45b4-b123-860819f262e2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:37.955040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d3615-d92d-45b4-b123-860819f262e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:37.956481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d3615-d92d-45b4-b123-860819f262e2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:37.978074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 234/474] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:37.979044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d3615-d92d-45b4-b123-860819f262e2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:37.999446 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762e83-447b-4b90-aec6-8e7ef93f8fd1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:38.047294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de666604-6a9c-4828-8b5c-a0aee95bbc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:38.047838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de666604-6a9c-4828-8b5c-a0aee95bbc50 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:38.048144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de666604-6a9c-4828-8b5c-a0aee95bbc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:38.048416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de666604-6a9c-4828-8b5c-a0aee95bbc50 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:38.049062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de666604-6a9c-4828-8b5c-a0aee95bbc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:38.049362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de666604-6a9c-4828-8b5c-a0aee95bbc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:38.051505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de666604-6a9c-4828-8b5c-a0aee95bbc50 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:38.070859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 241/475] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:38.070859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de666604-6a9c-4828-8b5c-a0aee95bbc50 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:38.108414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:38.128952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d3615-d92d-45b4-b123-860819f262e2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:38.171020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7b4ff-652c-4af0-a510-e5bb50004f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:38.171959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7b4ff-652c-4af0-a510-e5bb50004f49 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:38.172312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7b4ff-652c-4af0-a510-e5bb50004f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:38.172686 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7b4ff-652c-4af0-a510-e5bb50004f49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:38.180345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7b4ff-652c-4af0-a510-e5bb50004f49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:38.181775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de666604-6a9c-4828-8b5c-a0aee95bbc50 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:38.182235 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7b4ff-652c-4af0-a510-e5bb50004f49 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-cbc7b4ff-652c-4af0-a510-e5bb50004f49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:38.195106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:38.196599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:38.197624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:38.197624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:38.197624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:38.197624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:38.197624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:38.197624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:38.197624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:38.197624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:38.203436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 235/476] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:38.204403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7b4ff-652c-4af0-a510-e5bb50004f49 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:38.223206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24c961-34b9-4525-864f-87be7c6093ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:38.224070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24c961-34b9-4525-864f-87be7c6093ae None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:38.224482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24c961-34b9-4525-864f-87be7c6093ae None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:38.225142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24c961-34b9-4525-864f-87be7c6093ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:38.232268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:38.308637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24c961-34b9-4525-864f-87be7c6093ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:38.310370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24c961-34b9-4525-864f-87be7c6093ae None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:38.325279 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7b4ff-652c-4af0-a510-e5bb50004f49 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:38.357818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:38.362134 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa01e1-8472-41cc-94cb-edad4380fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:38.362771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa01e1-8472-41cc-94cb-edad4380fe52 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:38.363107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa01e1-8472-41cc-94cb-edad4380fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:38.363844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa01e1-8472-41cc-94cb-edad4380fe52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:38.371462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa01e1-8472-41cc-94cb-edad4380fe52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:38.373024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa01e1-8472-41cc-94cb-edad4380fe52 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4daa01e1-8472-41cc-94cb-edad4380fe52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:38.385797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:38.386887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 236/477] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:38.391713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa01e1-8472-41cc-94cb-edad4380fe52 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:38.438197 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 242/478] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:38.439990 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24c961-34b9-4525-864f-87be7c6093ae None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:38.502294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:38.528837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa01e1-8472-41cc-94cb-edad4380fe52 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:38.558497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24c961-34b9-4525-864f-87be7c6093ae None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:38.573553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65161ad-0a93-449c-a1c6-88e1a42b90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:38.574679 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65161ad-0a93-449c-a1c6-88e1a42b90e7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:38.575117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65161ad-0a93-449c-a1c6-88e1a42b90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:38.575770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65161ad-0a93-449c-a1c6-88e1a42b90e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:38.576963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65161ad-0a93-449c-a1c6-88e1a42b90e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:38.577405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65161ad-0a93-449c-a1c6-88e1a42b90e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:38.579510 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65161ad-0a93-449c-a1c6-88e1a42b90e7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:38.594580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc413d-65ca-4e18-bd9d-135af549f032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:38.595306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc413d-65ca-4e18-bd9d-135af549f032 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:38.595672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc413d-65ca-4e18-bd9d-135af549f032 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:38.595932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc413d-65ca-4e18-bd9d-135af549f032 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:38.596115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 237/479] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:38.596499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc413d-65ca-4e18-bd9d-135af549f032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:38.596831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc413d-65ca-4e18-bd9d-135af549f032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:38.597450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65161ad-0a93-449c-a1c6-88e1a42b90e7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:38.598299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc413d-65ca-4e18-bd9d-135af549f032 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:38.607146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:38.617458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 243/480] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:38.617458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc413d-65ca-4e18-bd9d-135af549f032 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:38.722662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65161ad-0a93-449c-a1c6-88e1a42b90e7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:38.735044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc413d-65ca-4e18-bd9d-135af549f032 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:38.759254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0aab6-fc7e-421a-b51c-6df0ec39e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:38.760047 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0aab6-fc7e-421a-b51c-6df0ec39e396 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:38.760422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0aab6-fc7e-421a-b51c-6df0ec39e396 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:38.760787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0aab6-fc7e-421a-b51c-6df0ec39e396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:38.775785 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0aab6-fc7e-421a-b51c-6df0ec39e396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:38.777367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0aab6-fc7e-421a-b51c-6df0ec39e396 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:38.778055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fd1bb-36e6-4a98-a0e2-382f847b1c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:38.778879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fd1bb-36e6-4a98-a0e2-382f847b1c04 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:38.779325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fd1bb-36e6-4a98-a0e2-382f847b1c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:38.779956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:38.780333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fd1bb-36e6-4a98-a0e2-382f847b1c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:38.781945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fd1bb-36e6-4a98-a0e2-382f847b1c04 None admin] RBAC: Adding query filter params (role.id=70b64fc972514149806cf9aeb00c7ce1, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=095bc16a66c24f44939009ac95e2bc3f) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:38.782393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fd1bb-36e6-4a98-a0e2-382f847b1c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:38.784073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fd1bb-36e6-4a98-a0e2-382f847b1c04 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:38.793412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 244/481] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:38 2022] GET /identity/v3/role_assignments?user.id=095bc16a66c24f44939009ac95e2bc3f&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=70b64fc972514149806cf9aeb00c7ce1 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:38.794734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fd1bb-36e6-4a98-a0e2-382f847b1c04 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-01d0aab6-fc7e-421a-b51c-6df0ec39e396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:38.800277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:38.801363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:38.802306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:38.802306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:38.802306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:38.807244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 238/482] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:38.809175 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0aab6-fc7e-421a-b51c-6df0ec39e396 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:38.935681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:39.008836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fd1bb-36e6-4a98-a0e2-382f847b1c04 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:39.019208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0aab6-fc7e-421a-b51c-6df0ec39e396 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:39.049075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74f94-6c9d-4fb2-9fc9-7d7e4e0b01d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:39.049798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74f94-6c9d-4fb2-9fc9-7d7e4e0b01d3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.050088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74f94-6c9d-4fb2-9fc9-7d7e4e0b01d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.050397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74f94-6c9d-4fb2-9fc9-7d7e4e0b01d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.051132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74f94-6c9d-4fb2-9fc9-7d7e4e0b01d3 None admin] RBAC: Adding query filter params (role.id=70b64fc972514149806cf9aeb00c7ce1, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=8af81f74f98b478ab71c0b22b365e3da) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:39.051439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74f94-6c9d-4fb2-9fc9-7d7e4e0b01d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:39.053596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74f94-6c9d-4fb2-9fc9-7d7e4e0b01d3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:39.060233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d402ab-16cd-4ed5-be7b-bee856949e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:39.060589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 245/483] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:38 2022] GET /identity/v3/role_assignments?user.id=8af81f74f98b478ab71c0b22b365e3da&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=70b64fc972514149806cf9aeb00c7ce1 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:39.061193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d402ab-16cd-4ed5-be7b-bee856949e73 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.061623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d402ab-16cd-4ed5-be7b-bee856949e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.062017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d402ab-16cd-4ed5-be7b-bee856949e73 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.062826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d402ab-16cd-4ed5-be7b-bee856949e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:39.063262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d402ab-16cd-4ed5-be7b-bee856949e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:39.065752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d402ab-16cd-4ed5-be7b-bee856949e73 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:39.080473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 239/484] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:39.086539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74f94-6c9d-4fb2-9fc9-7d7e4e0b01d3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:39.207751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74f94-6c9d-4fb2-9fc9-7d7e4e0b01d3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:39.245193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:39.260737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fde9b-5c8d-4e2f-bb62-29ab77cce6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:39.261402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fde9b-5c8d-4e2f-bb62-29ab77cce6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.261674 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fde9b-5c8d-4e2f-bb62-29ab77cce6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.261944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fde9b-5c8d-4e2f-bb62-29ab77cce6a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.276204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fde9b-5c8d-4e2f-bb62-29ab77cce6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:39.277702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fde9b-5c8d-4e2f-bb62-29ab77cce6a5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-029fde9b-5c8d-4e2f-bb62-29ab77cce6a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:39.292601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:39.293592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:39.294416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:39.294416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:39.294416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:39.294416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:39.294416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:39.294416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:39.294416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:39.294416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:39.296068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 246/485] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:39.301150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d402ab-16cd-4ed5-be7b-bee856949e73 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:39.374316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:39.398531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3d7a5-f546-4e19-8d73-13abec8c8fd0 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.398864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3d7a5-f546-4e19-8d73-13abec8c8fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.399114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3d7a5-f546-4e19-8d73-13abec8c8fd0 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.400831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 247/486] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:39.406740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09e9f9-e745-4db8-b127-b682dcebcacd None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.407041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09e9f9-e745-4db8-b127-b682dcebcacd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.407321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09e9f9-e745-4db8-b127-b682dcebcacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.423734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d402ab-16cd-4ed5-be7b-bee856949e73 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:39.430146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ca09e9f9-e745-4db8-b127-b682dcebcacd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:39.431535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ca09e9f9-e745-4db8-b127-b682dcebcacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:39.462301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09cb5f-7842-47a1-b3db-599b5587c549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:39.462878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09cb5f-7842-47a1-b3db-599b5587c549 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.463163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09cb5f-7842-47a1-b3db-599b5587c549 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.463432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09cb5f-7842-47a1-b3db-599b5587c549 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.464229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09cb5f-7842-47a1-b3db-599b5587c549 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:39.464638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09cb5f-7842-47a1-b3db-599b5587c549 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:39.466072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09cb5f-7842-47a1-b3db-599b5587c549 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:39.478934 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 240/487] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:39.485174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09cb5f-7842-47a1-b3db-599b5587c549 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:39.515755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 248/488] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:39.597174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09cb5f-7842-47a1-b3db-599b5587c549 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:39.611510 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:39.632971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4063b-b5a9-400c-af46-f83f3c855e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:39.633613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4063b-b5a9-400c-af46-f83f3c855e20 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.633919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4063b-b5a9-400c-af46-f83f3c855e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.634191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4063b-b5a9-400c-af46-f83f3c855e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.634955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4063b-b5a9-400c-af46-f83f3c855e20 None admin] RBAC: Adding query filter params (role.id=70b64fc972514149806cf9aeb00c7ce1, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=6ae71e9e597240ee88c6bd0754244aea) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:39.635272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4063b-b5a9-400c-af46-f83f3c855e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:39.636774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4063b-b5a9-400c-af46-f83f3c855e20 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:39.643552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 241/489] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:39 2022] GET /identity/v3/role_assignments?user.id=6ae71e9e597240ee88c6bd0754244aea&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=70b64fc972514149806cf9aeb00c7ce1 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:39.809018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09e9f9-e745-4db8-b127-b682dcebcacd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:39.942556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09e9f9-e745-4db8-b127-b682dcebcacd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:39.960237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:39.990103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d141db-98d5-445c-825f-667486054c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:39.990844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d141db-98d5-445c-825f-667486054c2d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.991123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d141db-98d5-445c-825f-667486054c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.991437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d141db-98d5-445c-825f-667486054c2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:40.004843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d141db-98d5-445c-825f-667486054c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-e8d141db-98d5-445c-825f-667486054c2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:40.009742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:40.010596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:40.011405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:40.013107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 249/490] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:40.017628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4063b-b5a9-400c-af46-f83f3c855e20 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:40.169546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4063b-b5a9-400c-af46-f83f3c855e20 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:40.217807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690295-afea-4dba-bd02-2ef2be2acc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:40.218434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690295-afea-4dba-bd02-2ef2be2acc92 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:40.218738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690295-afea-4dba-bd02-2ef2be2acc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:40.219004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690295-afea-4dba-bd02-2ef2be2acc92 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:40.219676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690295-afea-4dba-bd02-2ef2be2acc92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:40.219976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690295-afea-4dba-bd02-2ef2be2acc92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:40.221347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690295-afea-4dba-bd02-2ef2be2acc92 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:40.232204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 242/491] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:40.237612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d141db-98d5-445c-825f-667486054c2d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:40.241034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f1847-b683-40c1-91d2-c5c3b3018351 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:40.241329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f1847-b683-40c1-91d2-c5c3b3018351 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:40.241606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f1847-b683-40c1-91d2-c5c3b3018351 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:40.243274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 243/492] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:40.249526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c994b-dd4d-42dd-b4b6-12e68be93866 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:40.249526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c994b-dd4d-42dd-b4b6-12e68be93866 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:40.249526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c994b-dd4d-42dd-b4b6-12e68be93866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:40.268327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-614c994b-dd4d-42dd-b4b6-12e68be93866 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:40.269619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-614c994b-dd4d-42dd-b4b6-12e68be93866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:40.319271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:40.361583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 244/493] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:40.403987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d141db-98d5-445c-825f-667486054c2d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:40.455433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e0859-3c6d-4ceb-8b07-e7f8b5f12636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:40.456096 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e0859-3c6d-4ceb-8b07-e7f8b5f12636 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:40.456374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e0859-3c6d-4ceb-8b07-e7f8b5f12636 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:40.456644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e0859-3c6d-4ceb-8b07-e7f8b5f12636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:40.467973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e0859-3c6d-4ceb-8b07-e7f8b5f12636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:40.469430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e0859-3c6d-4ceb-8b07-e7f8b5f12636 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-244e0859-3c6d-4ceb-8b07-e7f8b5f12636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:40.488409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:40.489342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:40.491431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:40.491431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:40.491431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:40.491431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 250/494] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:40.495455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c994b-dd4d-42dd-b4b6-12e68be93866 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:40.638846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c994b-dd4d-42dd-b4b6-12e68be93866 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:40.671946 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d9267-5772-439f-ac82-dcdd1739f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:40.672561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d9267-5772-439f-ac82-dcdd1739f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:40.672842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d9267-5772-439f-ac82-dcdd1739f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:40.673118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d9267-5772-439f-ac82-dcdd1739f1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:40.673766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d9267-5772-439f-ac82-dcdd1739f1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:40.674072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d9267-5772-439f-ac82-dcdd1739f1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:40.675465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d9267-5772-439f-ac82-dcdd1739f1e4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:40.687246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 245/495] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:40.692865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e0859-3c6d-4ceb-8b07-e7f8b5f12636 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:40.741652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:40.831581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e0859-3c6d-4ceb-8b07-e7f8b5f12636 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:40.870234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52b19-ed4b-48b5-969c-891a51c64551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:40.870906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52b19-ed4b-48b5-969c-891a51c64551 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:40.871181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52b19-ed4b-48b5-969c-891a51c64551 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:40.871450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52b19-ed4b-48b5-969c-891a51c64551 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:40.879316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f52b19-ed4b-48b5-969c-891a51c64551 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:40.880748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f52b19-ed4b-48b5-969c-891a51c64551 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-48f52b19-ed4b-48b5-969c-891a51c64551 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:40.898046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:40.898997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:40.900048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 251/496] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:11:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:40.901742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d9267-5772-439f-ac82-dcdd1739f1e4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:40.904647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52b19-ed4b-48b5-969c-891a51c64551 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:40.966762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:41.001232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:41.014554 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52b19-ed4b-48b5-969c-891a51c64551 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:41.053645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073c478-820c-4303-9de6-21f8d812603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:41.054265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073c478-820c-4303-9de6-21f8d812603f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:41.054547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073c478-820c-4303-9de6-21f8d812603f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:41.054839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073c478-820c-4303-9de6-21f8d812603f None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:41.055576 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073c478-820c-4303-9de6-21f8d812603f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:41.055877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073c478-820c-4303-9de6-21f8d812603f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:41.057313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073c478-820c-4303-9de6-21f8d812603f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:41.092884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 252/497] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Oct 27 01:11:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:41.099513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073c478-820c-4303-9de6-21f8d812603f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:41.113007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d9267-5772-439f-ac82-dcdd1739f1e4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:41.195983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbc895-3774-4c7e-8385-4996a026fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:41.196685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbc895-3774-4c7e-8385-4996a026fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:41.196964 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbc895-3774-4c7e-8385-4996a026fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:41.197236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbc895-3774-4c7e-8385-4996a026fbb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:41.226392 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073c478-820c-4303-9de6-21f8d812603f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:41.231560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbc895-3774-4c7e-8385-4996a026fbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:41.233006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbc895-3774-4c7e-8385-4996a026fbb5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-29bbc895-3774-4c7e-8385-4996a026fbb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:41.260171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:41.261099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:41.262042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:41.262042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:41.262042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:41.262213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c1d56-9ff6-4bf5-92ca-ef117e282243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:41.262213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c1d56-9ff6-4bf5-92ca-ef117e282243 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:41.263551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 246/498] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:41.263626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c1d56-9ff6-4bf5-92ca-ef117e282243 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:41.263626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c1d56-9ff6-4bf5-92ca-ef117e282243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:41.267837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbc895-3774-4c7e-8385-4996a026fbb5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:41.279091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:41.335081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c1d56-9ff6-4bf5-92ca-ef117e282243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:41.336729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c1d56-9ff6-4bf5-92ca-ef117e282243 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:41.441036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 253/499] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 01:11:41.451537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c1d56-9ff6-4bf5-92ca-ef117e282243 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:41.471069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:41.492182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbc895-3774-4c7e-8385-4996a026fbb5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:41.505302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:41.535373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1afa37-1169-4003-b791-765262235804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:41.535962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1afa37-1169-4003-b791-765262235804 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:41.536302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1afa37-1169-4003-b791-765262235804 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:41.537412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1afa37-1169-4003-b791-765262235804 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:41.538076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1afa37-1169-4003-b791-765262235804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:41.538387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1afa37-1169-4003-b791-765262235804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:41.539839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1afa37-1169-4003-b791-765262235804 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:41.553010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 247/500] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:41.555165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11663a13-72ed-42d1-b657-a6ea208cf74b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:41.555747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11663a13-72ed-42d1-b657-a6ea208cf74b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:41.556368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11663a13-72ed-42d1-b657-a6ea208cf74b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:41.558306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 248/501] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:41.559214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11663a13-72ed-42d1-b657-a6ea208cf74b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:41.573237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c1d56-9ff6-4bf5-92ca-ef117e282243 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:41.610545 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562e6d7-61ba-42b4-903f-005a44ff7c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:41.611221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562e6d7-61ba-42b4-903f-005a44ff7c6d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:41.611500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562e6d7-61ba-42b4-903f-005a44ff7c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:41.611777 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562e6d7-61ba-42b4-903f-005a44ff7c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:41.624119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562e6d7-61ba-42b4-903f-005a44ff7c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:41.625562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562e6d7-61ba-42b4-903f-005a44ff7c6d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-9562e6d7-61ba-42b4-903f-005a44ff7c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:41.640601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:41.641991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:41.642899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:41.642899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:41.642899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:41.642899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 254/502] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:41.643532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f9b5a-6d29-4581-8cb4-6c8c73ce61ca None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:41.643636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f9b5a-6d29-4581-8cb4-6c8c73ce61ca None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:41.643838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f9b5a-6d29-4581-8cb4-6c8c73ce61ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:41.662284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-896f9b5a-6d29-4581-8cb4-6c8c73ce61ca None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:41.663519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-896f9b5a-6d29-4581-8cb4-6c8c73ce61ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:41.690159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11663a13-72ed-42d1-b657-a6ea208cf74b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:41.727324 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf4c91-f9da-4f02-bc32-a18ff6ba20fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:41.728017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf4c91-f9da-4f02-bc32-a18ff6ba20fa None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:41.728303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf4c91-f9da-4f02-bc32-a18ff6ba20fa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:41.728574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf4c91-f9da-4f02-bc32-a18ff6ba20fa None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:41.729399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf4c91-f9da-4f02-bc32-a18ff6ba20fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:41.731171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf4c91-f9da-4f02-bc32-a18ff6ba20fa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:41.749471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 255/503] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:41.750663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f9b5a-6d29-4581-8cb4-6c8c73ce61ca None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:41.760534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:41.774058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 249/504] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:11:41 2022] POST /identity/v3/users => generated 254 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:41.789093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:41.873283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f9b5a-6d29-4581-8cb4-6c8c73ce61ca None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:41.914091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231a70f-ef61-41c2-9f3e-ac850e1e3d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:41.914752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231a70f-ef61-41c2-9f3e-ac850e1e3d70 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:41.915190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231a70f-ef61-41c2-9f3e-ac850e1e3d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:41.915464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231a70f-ef61-41c2-9f3e-ac850e1e3d70 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:41.916144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231a70f-ef61-41c2-9f3e-ac850e1e3d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:41.916445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231a70f-ef61-41c2-9f3e-ac850e1e3d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:41.917858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231a70f-ef61-41c2-9f3e-ac850e1e3d70 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:41.931541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 256/505] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:41.937355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf4c91-f9da-4f02-bc32-a18ff6ba20fa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:42.002625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c639b38-9014-496b-acb9-ed609355048d None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.003127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c639b38-9014-496b-acb9-ed609355048d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.003410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c639b38-9014-496b-acb9-ed609355048d None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.005048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 257/506] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:11:42.011765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aea50-a41a-4b05-b13a-00f9cd67ba1e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.012731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aea50-a41a-4b05-b13a-00f9cd67ba1e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.013245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aea50-a41a-4b05-b13a-00f9cd67ba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.033874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-638aea50-a41a-4b05-b13a-00f9cd67ba1e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:42.035441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-638aea50-a41a-4b05-b13a-00f9cd67ba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:42.099091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf4c91-f9da-4f02-bc32-a18ff6ba20fa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:42.121542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 258/507] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:42.122332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aea50-a41a-4b05-b13a-00f9cd67ba1e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:42.141776 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c30cd-23bd-4e4b-a18a-fb57de6b5c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:42.142418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c30cd-23bd-4e4b-a18a-fb57de6b5c27 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.142697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c30cd-23bd-4e4b-a18a-fb57de6b5c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.142996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c30cd-23bd-4e4b-a18a-fb57de6b5c27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.150242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c30cd-23bd-4e4b-a18a-fb57de6b5c27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:42.150752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:42.151846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c30cd-23bd-4e4b-a18a-fb57de6b5c27 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-700c30cd-23bd-4e4b-a18a-fb57de6b5c27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:42.173168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:42.174129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:42.175025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:42.175025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:42.175025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:42.175025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:42.175025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:42.175025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:42.175025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:42.175025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:42.182048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 250/508] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:42.183096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c30cd-23bd-4e4b-a18a-fb57de6b5c27 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:42.249020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:42.256050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aea50-a41a-4b05-b13a-00f9cd67ba1e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:42.321281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bc7aa-cfdc-4355-90bc-487583f454b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:42.322172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bc7aa-cfdc-4355-90bc-487583f454b6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.322302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bc7aa-cfdc-4355-90bc-487583f454b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.322669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bc7aa-cfdc-4355-90bc-487583f454b6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.323184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bc7aa-cfdc-4355-90bc-487583f454b6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:42.324624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bc7aa-cfdc-4355-90bc-487583f454b6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:42.325897 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c30cd-23bd-4e4b-a18a-fb57de6b5c27 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-5e1bc7aa-cfdc-4355-90bc-487583f454b6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:42.346204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:42.347303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:42.348124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 259/509] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Oct 27 01:11:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:42.353286 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bc7aa-cfdc-4355-90bc-487583f454b6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:42.405308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19710131-e5ef-4a0e-8486-65fc6ef4d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:42.406328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19710131-e5ef-4a0e-8486-65fc6ef4d988 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.406831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19710131-e5ef-4a0e-8486-65fc6ef4d988 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.407320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19710131-e5ef-4a0e-8486-65fc6ef4d988 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.408219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19710131-e5ef-4a0e-8486-65fc6ef4d988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:42.408716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19710131-e5ef-4a0e-8486-65fc6ef4d988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:42.410350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19710131-e5ef-4a0e-8486-65fc6ef4d988 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:42.437095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 251/510] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:42.438073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:42.438767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19710131-e5ef-4a0e-8486-65fc6ef4d988 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:42.457939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bc7aa-cfdc-4355-90bc-487583f454b6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:42.498248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103629d0-f5bf-406e-8287-12d7106fbb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:42.499360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103629d0-f5bf-406e-8287-12d7106fbb0a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.499738 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103629d0-f5bf-406e-8287-12d7106fbb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.500109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103629d0-f5bf-406e-8287-12d7106fbb0a None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.500871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103629d0-f5bf-406e-8287-12d7106fbb0a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:42.501245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103629d0-f5bf-406e-8287-12d7106fbb0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:42.502751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103629d0-f5bf-406e-8287-12d7106fbb0a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:42.507788 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 260/511] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Oct 27 01:11:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:42.514099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103629d0-f5bf-406e-8287-12d7106fbb0a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:42.561417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19710131-e5ef-4a0e-8486-65fc6ef4d988 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:42.580329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:42.599425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9e5b3-d117-490f-b0c3-8785f28345dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:42.600062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9e5b3-d117-490f-b0c3-8785f28345dc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.600341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9e5b3-d117-490f-b0c3-8785f28345dc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.600613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9e5b3-d117-490f-b0c3-8785f28345dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.611152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9e5b3-d117-490f-b0c3-8785f28345dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-bda9e5b3-d117-490f-b0c3-8785f28345dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:42.615623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:42.616509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:42.617328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 252/512] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:42.618579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9e5b3-d117-490f-b0c3-8785f28345dc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:42.628438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103629d0-f5bf-406e-8287-12d7106fbb0a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:42.663337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77baa0-3ec1-489a-9962-4eb8fe57432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:42.664003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77baa0-3ec1-489a-9962-4eb8fe57432c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.664283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77baa0-3ec1-489a-9962-4eb8fe57432c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.664546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77baa0-3ec1-489a-9962-4eb8fe57432c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.665342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77baa0-3ec1-489a-9962-4eb8fe57432c None admin] RBAC: Adding query filter params (role.id=70b64fc972514149806cf9aeb00c7ce1, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=b38639ab90e5439a990cf603c627dab3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:42.665647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77baa0-3ec1-489a-9962-4eb8fe57432c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:42.667101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77baa0-3ec1-489a-9962-4eb8fe57432c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:42.673259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 261/513] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:42 2022] GET /identity/v3/role_assignments?user.id=b38639ab90e5439a990cf603c627dab3&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=70b64fc972514149806cf9aeb00c7ce1 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:42.674470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345925-6301-40a4-b8c9-fb6268d1ef41 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.674728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345925-6301-40a4-b8c9-fb6268d1ef41 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.675013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345925-6301-40a4-b8c9-fb6268d1ef41 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.681005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 262/514] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:42.681005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d345925-6301-40a4-b8c9-fb6268d1ef41 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:42.695486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:42.758345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9e5b3-d117-490f-b0c3-8785f28345dc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:42.801619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6333959-0b1f-45c4-bf8d-b1462d0c332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:42.802564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6333959-0b1f-45c4-bf8d-b1462d0c332d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.803060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6333959-0b1f-45c4-bf8d-b1462d0c332d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.803515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6333959-0b1f-45c4-bf8d-b1462d0c332d None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.804512 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6333959-0b1f-45c4-bf8d-b1462d0c332d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:42.805054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6333959-0b1f-45c4-bf8d-b1462d0c332d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:42.805458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d345925-6301-40a4-b8c9-fb6268d1ef41 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:42.806939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6333959-0b1f-45c4-bf8d-b1462d0c332d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:42.813889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 253/515] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Oct 27 01:11:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:42.815705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8e88-bd10-4f2d-9ac1-76e4b59bc241 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.816254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8e88-bd10-4f2d-9ac1-76e4b59bc241 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.816723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8e88-bd10-4f2d-9ac1-76e4b59bc241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.836277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-aead8e88-bd10-4f2d-9ac1-76e4b59bc241 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:42.837999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aead8e88-bd10-4f2d-9ac1-76e4b59bc241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:42.882434 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e2922-c225-46ee-aec4-7f750f4e58fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:42.883075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e2922-c225-46ee-aec4-7f750f4e58fe None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:42.883351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e2922-c225-46ee-aec4-7f750f4e58fe None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:42.885117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e2922-c225-46ee-aec4-7f750f4e58fe None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:42.885117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e2922-c225-46ee-aec4-7f750f4e58fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:42.885117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e2922-c225-46ee-aec4-7f750f4e58fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:42.886065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e2922-c225-46ee-aec4-7f750f4e58fe None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:42.908617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:42.909592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 263/516] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:42.910807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e2922-c225-46ee-aec4-7f750f4e58fe None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:42.955358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 254/517] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 01:11:43.013317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:43.046957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e2922-c225-46ee-aec4-7f750f4e58fe None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:43.081500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf92e6-fa60-415c-942c-3a8ebbe4f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:43.082146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf92e6-fa60-415c-942c-3a8ebbe4f037 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:43.082425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf92e6-fa60-415c-942c-3a8ebbe4f037 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:43.082700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf92e6-fa60-415c-942c-3a8ebbe4f037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:43.093228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf92e6-fa60-415c-942c-3a8ebbe4f037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:43.094762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf92e6-fa60-415c-942c-3a8ebbe4f037 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-0bbf92e6-fa60-415c-942c-3a8ebbe4f037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:43.110810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:43.111789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:43.112663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:43.112663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:43.112663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:43.112663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 264/518] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:43.117783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8e88-bd10-4f2d-9ac1-76e4b59bc241 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:43.233364 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8e88-bd10-4f2d-9ac1-76e4b59bc241 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:43.242420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf92e6-fa60-415c-942c-3a8ebbe4f037 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:43.313316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cd06d-fd9d-485b-88f2-b3dbf1d67113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:43.313948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cd06d-fd9d-485b-88f2-b3dbf1d67113 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:43.314224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cd06d-fd9d-485b-88f2-b3dbf1d67113 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:43.314511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cd06d-fd9d-485b-88f2-b3dbf1d67113 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:43.315174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cd06d-fd9d-485b-88f2-b3dbf1d67113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:43.315480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cd06d-fd9d-485b-88f2-b3dbf1d67113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:43.316930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cd06d-fd9d-485b-88f2-b3dbf1d67113 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:43.342914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 255/519] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:43.347731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cd06d-fd9d-485b-88f2-b3dbf1d67113 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:43.394572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:43.413596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf92e6-fa60-415c-942c-3a8ebbe4f037 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:43.461216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:43.484186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859a8d1-594e-4aab-b4b6-ea622978e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:43.484947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859a8d1-594e-4aab-b4b6-ea622978e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:43.485228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859a8d1-594e-4aab-b4b6-ea622978e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:43.485533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859a8d1-594e-4aab-b4b6-ea622978e7d4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:43.486132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859a8d1-594e-4aab-b4b6-ea622978e7d4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:43.487535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859a8d1-594e-4aab-b4b6-ea622978e7d4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a859a8d1-594e-4aab-b4b6-ea622978e7d4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:43.501338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:43.502330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:11:43.503186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:43.503971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 265/520] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:43 2022] GET /identity/v3/services/network => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:43.515598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859a8d1-594e-4aab-b4b6-ea622978e7d4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:43.521320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cd06d-fd9d-485b-88f2-b3dbf1d67113 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:43.556757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc2672-c780-42fd-be4d-d13350781592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:43.557503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc2672-c780-42fd-be4d-d13350781592 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:43.557785 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc2672-c780-42fd-be4d-d13350781592 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:43.558053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc2672-c780-42fd-be4d-d13350781592 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:43.566672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc2672-c780-42fd-be4d-d13350781592 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:43.568148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc2672-c780-42fd-be4d-d13350781592 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-73bc2672-c780-42fd-be4d-d13350781592 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:43.588815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:43.589782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:43.590730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 256/521] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Oct 27 01:11:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:43.596031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc2672-c780-42fd-be4d-d13350781592 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:43.699218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859a8d1-594e-4aab-b4b6-ea622978e7d4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:43.757257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f335ca-8b6b-47c4-ad3f-852337ef1e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:43.758216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f335ca-8b6b-47c4-ad3f-852337ef1e7a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:43.758820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f335ca-8b6b-47c4-ad3f-852337ef1e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:43.759304 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f335ca-8b6b-47c4-ad3f-852337ef1e7a None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:43.760183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f335ca-8b6b-47c4-ad3f-852337ef1e7a None admin] RBAC: Adding query filter params (name=network) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:43.760678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f335ca-8b6b-47c4-ad3f-852337ef1e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:43.763509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f335ca-8b6b-47c4-ad3f-852337ef1e7a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:43.774014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:43.776066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 266/522] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:11:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:43.781804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f335ca-8b6b-47c4-ad3f-852337ef1e7a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:43.788622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc2672-c780-42fd-be4d-d13350781592 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:43.861023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bbf3d-db16-4b48-b403-a1aff325a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:43.861654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bbf3d-db16-4b48-b403-a1aff325a4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:43.861976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bbf3d-db16-4b48-b403-a1aff325a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:43.862251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bbf3d-db16-4b48-b403-a1aff325a4d6 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:43.863030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bbf3d-db16-4b48-b403-a1aff325a4d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:43.863334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bbf3d-db16-4b48-b403-a1aff325a4d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:43.866008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bbf3d-db16-4b48-b403-a1aff325a4d6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:43.883103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:43.897900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 257/523] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Oct 27 01:11:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:43.904012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bbf3d-db16-4b48-b403-a1aff325a4d6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:43.984339 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f335ca-8b6b-47c4-ad3f-852337ef1e7a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:44.048021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482cd50-1845-4af9-aeb8-20727871cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:44.048576 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482cd50-1845-4af9-aeb8-20727871cd66 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:44.048835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482cd50-1845-4af9-aeb8-20727871cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:44.049107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482cd50-1845-4af9-aeb8-20727871cd66 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:44.049752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482cd50-1845-4af9-aeb8-20727871cd66 None admin] RBAC: Adding query filter params (type=network) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:44.050050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482cd50-1845-4af9-aeb8-20727871cd66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:44.051444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482cd50-1845-4af9-aeb8-20727871cd66 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:44.059140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 267/524] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:11:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:44.086526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bbf3d-db16-4b48-b403-a1aff325a4d6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:44.145524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d068a-9083-4b46-a52c-fb4a9c0c0dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:44.146187 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d068a-9083-4b46-a52c-fb4a9c0c0dda None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:44.146464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d068a-9083-4b46-a52c-fb4a9c0c0dda None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:44.146749 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d068a-9083-4b46-a52c-fb4a9c0c0dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:44.157924 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d068a-9083-4b46-a52c-fb4a9c0c0dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:44.159432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d068a-9083-4b46-a52c-fb4a9c0c0dda None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8a8d068a-9083-4b46-a52c-fb4a9c0c0dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:44.175594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:44.176589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:44.177476 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:44.177476 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:44.177476 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:44.177476 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 258/525] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:44.185135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482cd50-1845-4af9-aeb8-20727871cd66 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:44.326997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482cd50-1845-4af9-aeb8-20727871cd66 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:44.355842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:44.377082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8aea7-c9d1-4140-92b8-2dd2ed92c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:44.378095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8aea7-c9d1-4140-92b8-2dd2ed92c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:44.378605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8aea7-c9d1-4140-92b8-2dd2ed92c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:44.378911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8aea7-c9d1-4140-92b8-2dd2ed92c9e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:44.379606 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8aea7-c9d1-4140-92b8-2dd2ed92c9e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:44.379908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8aea7-c9d1-4140-92b8-2dd2ed92c9e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:44.381293 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8aea7-c9d1-4140-92b8-2dd2ed92c9e9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:44.394807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 268/526] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:44.400355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d068a-9083-4b46-a52c-fb4a9c0c0dda None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:44.403407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:44.476582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf530-cacd-4443-aaeb-01e5355ba813 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:44.477104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf530-cacd-4443-aaeb-01e5355ba813 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:44.477181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf530-cacd-4443-aaeb-01e5355ba813 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:44.478958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 269/527] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:44.485059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaef59f-5f0c-4f5c-bb3c-1f0ff8f69a8a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:44.485771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaef59f-5f0c-4f5c-bb3c-1f0ff8f69a8a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:44.486148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaef59f-5f0c-4f5c-bb3c-1f0ff8f69a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:44.509720 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6aaef59f-5f0c-4f5c-bb3c-1f0ff8f69a8a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:44.511048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6aaef59f-5f0c-4f5c-bb3c-1f0ff8f69a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:44.511569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d068a-9083-4b46-a52c-fb4a9c0c0dda None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:44.553768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce0c7e-0197-4e45-ba83-bc0543d403c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:44.555856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce0c7e-0197-4e45-ba83-bc0543d403c8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:44.557434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce0c7e-0197-4e45-ba83-bc0543d403c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:44.557967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce0c7e-0197-4e45-ba83-bc0543d403c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:44.571216 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce0c7e-0197-4e45-ba83-bc0543d403c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:44.573943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce0c7e-0197-4e45-ba83-bc0543d403c8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-bdce0c7e-0197-4e45-ba83-bc0543d403c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:44.597700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:44.598611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:44.599574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:44.599574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:44.599574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:44.599574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:44.599574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:44.599574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:44.599574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:44.599574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:44.608203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 259/528] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:44.611125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce0c7e-0197-4e45-ba83-bc0543d403c8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:44.628654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 270/529] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:44.702144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:44.747545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce0c7e-0197-4e45-ba83-bc0543d403c8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:44.786660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cd848-db04-4e73-941c-27f5e17531dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:44.787701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd848-db04-4e73-941c-27f5e17531dd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:44.788193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd848-db04-4e73-941c-27f5e17531dd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:44.788665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd848-db04-4e73-941c-27f5e17531dd None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:44.789576 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cd848-db04-4e73-941c-27f5e17531dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:44.790127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cd848-db04-4e73-941c-27f5e17531dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:44.791780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cd848-db04-4e73-941c-27f5e17531dd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:44.809465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 260/530] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:44.815396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaef59f-5f0c-4f5c-bb3c-1f0ff8f69a8a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:44.937697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaef59f-5f0c-4f5c-bb3c-1f0ff8f69a8a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:44.945603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:44.979634 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2c31-82d7-4043-8453-f0a63ea32c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:44.980316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2c31-82d7-4043-8453-f0a63ea32c54 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:44.980593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2c31-82d7-4043-8453-f0a63ea32c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:44.980867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2c31-82d7-4043-8453-f0a63ea32c54 None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/8af81f74f98b478ab71c0b22b365e3da/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:44.986868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa2c31-82d7-4043-8453-f0a63ea32c54 None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=8af81f74f98b478ab71c0b22b365e3da, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:44.988354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa2c31-82d7-4043-8453-f0a63ea32c54 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:45.009407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 271/531] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:44 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/8af81f74f98b478ab71c0b22b365e3da/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:45.011989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cd848-db04-4e73-941c-27f5e17531dd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:45.122587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cd848-db04-4e73-941c-27f5e17531dd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:45.151092 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:45.166708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8f287-8a0f-42d7-8ab5-4fbaf0e37bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:45.167380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8f287-8a0f-42d7-8ab5-4fbaf0e37bcb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:45.167660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8f287-8a0f-42d7-8ab5-4fbaf0e37bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:45.167933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8f287-8a0f-42d7-8ab5-4fbaf0e37bcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:45.182833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8f287-8a0f-42d7-8ab5-4fbaf0e37bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e7f8f287-8a0f-42d7-8ab5-4fbaf0e37bcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:45.187911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:45.188811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:45.190056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 261/532] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:45.195476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2c31-82d7-4043-8453-f0a63ea32c54 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:45.322210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2c31-82d7-4043-8453-f0a63ea32c54 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:45.363948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678c5d3-d181-4bd1-af6f-d310054e70dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:45.364595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678c5d3-d181-4bd1-af6f-d310054e70dd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:45.364872 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678c5d3-d181-4bd1-af6f-d310054e70dd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:45.365144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678c5d3-d181-4bd1-af6f-d310054e70dd None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:45.365834 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678c5d3-d181-4bd1-af6f-d310054e70dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:45.366135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678c5d3-d181-4bd1-af6f-d310054e70dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:45.367578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678c5d3-d181-4bd1-af6f-d310054e70dd None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:45.377604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 272/533] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:45.383453 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8f287-8a0f-42d7-8ab5-4fbaf0e37bcb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:45.445527 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01355007-63c3-4a96-9cc4-af2943cd76c7 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:45.445848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01355007-63c3-4a96-9cc4-af2943cd76c7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:45.446069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01355007-63c3-4a96-9cc4-af2943cd76c7 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:45.447735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 273/534] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:45.452706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29f88-9179-4332-a66c-088698a10e6f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:45.452985 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29f88-9179-4332-a66c-088698a10e6f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:45.453260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29f88-9179-4332-a66c-088698a10e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:45.488365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0fc29f88-9179-4332-a66c-088698a10e6f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:45.489569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0fc29f88-9179-4332-a66c-088698a10e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:45.521421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:45.521740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8f287-8a0f-42d7-8ab5-4fbaf0e37bcb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:45.569553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169ba67-a17e-47d3-81e5-872731b6e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:45.570191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169ba67-a17e-47d3-81e5-872731b6e482 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:45.570733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169ba67-a17e-47d3-81e5-872731b6e482 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:45.571118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169ba67-a17e-47d3-81e5-872731b6e482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:45.576584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 274/535] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:45.578086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386592f6-341f-4751-8ba6-d90ae8256c03 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:45.578560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386592f6-341f-4751-8ba6-d90ae8256c03 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:45.579044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386592f6-341f-4751-8ba6-d90ae8256c03 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:45.584665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 275/536] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:45.586434 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0be0-aa3c-4659-aa60-3d6042e6b964 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:45.587008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0be0-aa3c-4659-aa60-3d6042e6b964 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:45.587517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0be0-aa3c-4659-aa60-3d6042e6b964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:45.591769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169ba67-a17e-47d3-81e5-872731b6e482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:45.593526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169ba67-a17e-47d3-81e5-872731b6e482 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:45.607398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c56a0be0-aa3c-4659-aa60-3d6042e6b964 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:45.608888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c56a0be0-aa3c-4659-aa60-3d6042e6b964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8169ba67-a17e-47d3-81e5-872731b6e482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:45.624060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:45.625020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:45.625907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:45.625907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:45.625907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:45.632452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 262/537] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:45.636770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169ba67-a17e-47d3-81e5-872731b6e482 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:45.702010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:45.729082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 276/538] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:45.780920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169ba67-a17e-47d3-81e5-872731b6e482 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:45.815396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e61d3-6d03-4a26-8a52-5e2555ba75a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:45.816398 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e61d3-6d03-4a26-8a52-5e2555ba75a1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:45.816867 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e61d3-6d03-4a26-8a52-5e2555ba75a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:45.817336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e61d3-6d03-4a26-8a52-5e2555ba75a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:45.818195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e61d3-6d03-4a26-8a52-5e2555ba75a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:45.818685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e61d3-6d03-4a26-8a52-5e2555ba75a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:45.820371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e61d3-6d03-4a26-8a52-5e2555ba75a1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:45.832832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 263/539] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:45.844140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0be0-aa3c-4659-aa60-3d6042e6b964 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:45.898423 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e61d3-6d03-4a26-8a52-5e2555ba75a1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:45.973473 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:45.993300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0be0-aa3c-4659-aa60-3d6042e6b964 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:46.062559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fe8cf-9f55-4c5c-9f2c-b062b6cc46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:46.063243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fe8cf-9f55-4c5c-9f2c-b062b6cc46c0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.063522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fe8cf-9f55-4c5c-9f2c-b062b6cc46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.063798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fe8cf-9f55-4c5c-9f2c-b062b6cc46c0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.077333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fe8cf-9f55-4c5c-9f2c-b062b6cc46c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:46.079862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fe8cf-9f55-4c5c-9f2c-b062b6cc46c0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:46.082579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ba7fe8cf-9f55-4c5c-9f2c-b062b6cc46c0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:46.093507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:46.094485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:11:46.095439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:46.095962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e61d3-6d03-4a26-8a52-5e2555ba75a1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:46.096034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 277/540] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Oct 27 01:11:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:46.096034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fe8cf-9f55-4c5c-9f2c-b062b6cc46c0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:46.133329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edccf9-2bde-4771-8fb0-71972fb04063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:46.133975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edccf9-2bde-4771-8fb0-71972fb04063 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.134251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edccf9-2bde-4771-8fb0-71972fb04063 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.134519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edccf9-2bde-4771-8fb0-71972fb04063 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.135208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edccf9-2bde-4771-8fb0-71972fb04063 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:46.136569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edccf9-2bde-4771-8fb0-71972fb04063 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:46.154750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 264/541] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:11:45 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:11:46.155776 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edccf9-2bde-4771-8fb0-71972fb04063 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:46.214236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fe8cf-9f55-4c5c-9f2c-b062b6cc46c0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:46.272220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f3755-03c9-438f-b785-614a55b351d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:46.272889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f3755-03c9-438f-b785-614a55b351d6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.273175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f3755-03c9-438f-b785-614a55b351d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.273551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f3755-03c9-438f-b785-614a55b351d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.277295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edccf9-2bde-4771-8fb0-71972fb04063 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:46.288991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f3755-03c9-438f-b785-614a55b351d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-282f3755-03c9-438f-b785-614a55b351d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:46.295199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:46.296097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:46.296896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 278/542] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:11:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:46.305779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f3755-03c9-438f-b785-614a55b351d6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:46.315481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:46.326085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba180e-824c-44f9-83de-bc59fff0040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:46.326745 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba180e-824c-44f9-83de-bc59fff0040d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.327035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba180e-824c-44f9-83de-bc59fff0040d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.327303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba180e-824c-44f9-83de-bc59fff0040d None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.328083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba180e-824c-44f9-83de-bc59fff0040d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:46.328386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba180e-824c-44f9-83de-bc59fff0040d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:46.329918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba180e-824c-44f9-83de-bc59fff0040d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:46.351427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 265/543] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Oct 27 01:11:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:46.358062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba180e-824c-44f9-83de-bc59fff0040d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:46.396648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:46.472487 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f3755-03c9-438f-b785-614a55b351d6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:46.496635 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba180e-824c-44f9-83de-bc59fff0040d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:46.507738 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257cabb-68fd-418b-a0bf-34ec52c4ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:46.509095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257cabb-68fd-418b-a0bf-34ec52c4ef8f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.509595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257cabb-68fd-418b-a0bf-34ec52c4ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.510055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257cabb-68fd-418b-a0bf-34ec52c4ef8f None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.510935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257cabb-68fd-418b-a0bf-34ec52c4ef8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:46.511429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257cabb-68fd-418b-a0bf-34ec52c4ef8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:46.513383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257cabb-68fd-418b-a0bf-34ec52c4ef8f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:46.522443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 279/544] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:46.528534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257cabb-68fd-418b-a0bf-34ec52c4ef8f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:46.548211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a383d-92ce-4541-9329-86ed2297229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:46.548943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a383d-92ce-4541-9329-86ed2297229a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.549220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a383d-92ce-4541-9329-86ed2297229a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.549539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a383d-92ce-4541-9329-86ed2297229a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.562133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a383d-92ce-4541-9329-86ed2297229a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:46.563786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a383d-92ce-4541-9329-86ed2297229a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-049a383d-92ce-4541-9329-86ed2297229a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:46.582384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:46.583432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:46.584312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:46.584312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:46.584312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:46.584312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 266/545] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:46.590750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a383d-92ce-4541-9329-86ed2297229a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:46.616410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:46.658904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:46.669171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257cabb-68fd-418b-a0bf-34ec52c4ef8f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:46.710707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f4f6-464f-4128-a4e8-e96fe7b35144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:46.711380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f4f6-464f-4128-a4e8-e96fe7b35144 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.711785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f4f6-464f-4128-a4e8-e96fe7b35144 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.712064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f4f6-464f-4128-a4e8-e96fe7b35144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.713425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a383d-92ce-4541-9329-86ed2297229a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:46.725781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f4f6-464f-4128-a4e8-e96fe7b35144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:46.727421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f4f6-464f-4128-a4e8-e96fe7b35144 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a405f4f6-464f-4128-a4e8-e96fe7b35144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:46.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:46.746161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:46.750548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:46.750548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:46.750548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:46.750548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 280/546] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:46.750548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691bed-0af9-4ba9-bbc8-88d6da4a466c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.750548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691bed-0af9-4ba9-bbc8-88d6da4a466c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.750548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691bed-0af9-4ba9-bbc8-88d6da4a466c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.750548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 281/547] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:46.755214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abd22a-097c-4ac3-ab91-4e1965cd544e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.755495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abd22a-097c-4ac3-ab91-4e1965cd544e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.755838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abd22a-097c-4ac3-ab91-4e1965cd544e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.757732 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c88843-d966-4916-abba-c8fb8ae35509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:46.758568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c88843-d966-4916-abba-c8fb8ae35509 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.759132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c88843-d966-4916-abba-c8fb8ae35509 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.759650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c88843-d966-4916-abba-c8fb8ae35509 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.760556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c88843-d966-4916-abba-c8fb8ae35509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:46.760997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c88843-d966-4916-abba-c8fb8ae35509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:46.762997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c88843-d966-4916-abba-c8fb8ae35509 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:46.776790 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 267/548] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:46.776957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c1abd22a-097c-4ac3-ab91-4e1965cd544e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:46.778090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c1abd22a-097c-4ac3-ab91-4e1965cd544e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:46.778316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c88843-d966-4916-abba-c8fb8ae35509 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:46.860386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 282/549] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 01:11:46.861512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abd22a-097c-4ac3-ab91-4e1965cd544e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:46.915278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c88843-d966-4916-abba-c8fb8ae35509 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:46.965536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:46.970181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:46.985410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5b85e-4854-4dfe-952e-e8c1b5a441aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:46.986024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5b85e-4854-4dfe-952e-e8c1b5a441aa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:46.986489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5b85e-4854-4dfe-952e-e8c1b5a441aa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:46.986784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5b85e-4854-4dfe-952e-e8c1b5a441aa None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:46.988466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5b85e-4854-4dfe-952e-e8c1b5a441aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:46.988777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5b85e-4854-4dfe-952e-e8c1b5a441aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:46.990136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5b85e-4854-4dfe-952e-e8c1b5a441aa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:47.020275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 268/550] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:47.022856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5b85e-4854-4dfe-952e-e8c1b5a441aa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:47.069909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abd22a-097c-4ac3-ab91-4e1965cd544e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:47.144397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be9fce-8ec0-4c18-bb88-2332084f22c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:47.145509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be9fce-8ec0-4c18-bb88-2332084f22c7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:47.146002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be9fce-8ec0-4c18-bb88-2332084f22c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:47.146261 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5b85e-4854-4dfe-952e-e8c1b5a441aa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:47.146680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be9fce-8ec0-4c18-bb88-2332084f22c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:47.167983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be9fce-8ec0-4c18-bb88-2332084f22c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:47.170194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be9fce-8ec0-4c18-bb88-2332084f22c7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-d1be9fce-8ec0-4c18-bb88-2332084f22c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:47.188012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:47.189017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:47.189908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:47.189908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:47.189908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:47.189908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:47.189908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:47.189908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:47.189908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:47.189908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:47.194094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 283/551] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:47.195147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be9fce-8ec0-4c18-bb88-2332084f22c7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:47.197818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa29d7-131f-4d8c-9c05-35c19a3c2b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:47.199078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa29d7-131f-4d8c-9c05-35c19a3c2b55 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:47.200551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa29d7-131f-4d8c-9c05-35c19a3c2b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:47.201044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa29d7-131f-4d8c-9c05-35c19a3c2b55 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:47.211348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa29d7-131f-4d8c-9c05-35c19a3c2b55 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:47.214096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa29d7-131f-4d8c-9c05-35c19a3c2b55 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-13fa29d7-131f-4d8c-9c05-35c19a3c2b55 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:47.231194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:47.232199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:11:47.233125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:47.236439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 269/552] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:11:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:47.237412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa29d7-131f-4d8c-9c05-35c19a3c2b55 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:47.302711 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:47.315276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be9fce-8ec0-4c18-bb88-2332084f22c7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:47.326333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:47.355320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4bae2-d651-4bee-96ff-68348d86e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:47.356298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4bae2-d651-4bee-96ff-68348d86e8ce None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:47.356786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4bae2-d651-4bee-96ff-68348d86e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:47.357231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4bae2-d651-4bee-96ff-68348d86e8ce None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:47.358073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4bae2-d651-4bee-96ff-68348d86e8ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:47.359769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4bae2-d651-4bee-96ff-68348d86e8ce None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:47.377705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa29d7-131f-4d8c-9c05-35c19a3c2b55 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:47.380393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 284/553] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:11:47 2022] POST /identity/v3/services => generated 240 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:47.381431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4bae2-d651-4bee-96ff-68348d86e8ce None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:47.477150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f6f9-4071-40ff-b598-584a2e48e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:47.478322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f6f9-4071-40ff-b598-584a2e48e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:47.478970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f6f9-4071-40ff-b598-584a2e48e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:47.479479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f6f9-4071-40ff-b598-584a2e48e3c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:47.480440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5f6f9-4071-40ff-b598-584a2e48e3c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:47.480965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5f6f9-4071-40ff-b598-584a2e48e3c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:47.485172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5f6f9-4071-40ff-b598-584a2e48e3c2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:47.514161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 270/554] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:47.540818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f6f9-4071-40ff-b598-584a2e48e3c2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:47.606184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4bae2-d651-4bee-96ff-68348d86e8ce None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:47.657023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb7ab1-bbcf-4cd3-91c3-76c747a7112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:47.658632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb7ab1-bbcf-4cd3-91c3-76c747a7112c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:47.659218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb7ab1-bbcf-4cd3-91c3-76c747a7112c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:47.659700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb7ab1-bbcf-4cd3-91c3-76c747a7112c None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:47.660717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb7ab1-bbcf-4cd3-91c3-76c747a7112c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:47.661222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb7ab1-bbcf-4cd3-91c3-76c747a7112c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:47.662991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb7ab1-bbcf-4cd3-91c3-76c747a7112c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:47.685095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 285/555] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Oct 27 01:11:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:47.690623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb7ab1-bbcf-4cd3-91c3-76c747a7112c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:47.693087 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:47.699465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f6f9-4071-40ff-b598-584a2e48e3c2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:47.731449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:47.746171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22994-3f50-47aa-933a-249fe4a004bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:47.747045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22994-3f50-47aa-933a-249fe4a004bb None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:47.747424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22994-3f50-47aa-933a-249fe4a004bb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:47.747797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22994-3f50-47aa-933a-249fe4a004bb None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/22b2d94a0f0c442688ef74359536281e/roles/70b64fc972514149806cf9aeb00c7ce1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:47.771723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22994-3f50-47aa-933a-249fe4a004bb None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=22b2d94a0f0c442688ef74359536281e, role_id=70b64fc972514149806cf9aeb00c7ce1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:47.773362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22994-3f50-47aa-933a-249fe4a004bb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:47.797334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 271/556] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:47 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/22b2d94a0f0c442688ef74359536281e/roles/70b64fc972514149806cf9aeb00c7ce1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:47.798702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f916836-d972-4e6b-b59a-e3a8ea5543bb None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:47.799083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f916836-d972-4e6b-b59a-e3a8ea5543bb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:47.799355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f916836-d972-4e6b-b59a-e3a8ea5543bb None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:47.805837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 272/557] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:47.810585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572a9f1-0049-42f5-876a-add972f77daf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:47.810978 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572a9f1-0049-42f5-876a-add972f77daf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:47.811265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572a9f1-0049-42f5-876a-add972f77daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:47.847796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9572a9f1-0049-42f5-876a-add972f77daf None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:47.849950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9572a9f1-0049-42f5-876a-add972f77daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:47.872901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb7ab1-bbcf-4cd3-91c3-76c747a7112c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:47.934169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 273/558] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:47.969487 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3013a7-c302-421e-a851-8bb867e1da70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:47.970153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3013a7-c302-421e-a851-8bb867e1da70 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:47.970428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3013a7-c302-421e-a851-8bb867e1da70 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:47.970700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3013a7-c302-421e-a851-8bb867e1da70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:47.990681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3013a7-c302-421e-a851-8bb867e1da70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:47.992173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3013a7-c302-421e-a851-8bb867e1da70 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-bf3013a7-c302-421e-a851-8bb867e1da70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:48.011240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:48.012254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:48.013508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:48.013508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:48.013508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:48.013508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 286/559] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:48.018751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572a9f1-0049-42f5-876a-add972f77daf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:48.126595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:48.149204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572a9f1-0049-42f5-876a-add972f77daf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:48.184311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d31874-cf58-47a2-b6e9-96e7728a3270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:48.184934 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d31874-cf58-47a2-b6e9-96e7728a3270 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:48.185213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d31874-cf58-47a2-b6e9-96e7728a3270 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:48.185487 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d31874-cf58-47a2-b6e9-96e7728a3270 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:48.186142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d31874-cf58-47a2-b6e9-96e7728a3270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:48.186446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d31874-cf58-47a2-b6e9-96e7728a3270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:48.187850 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d31874-cf58-47a2-b6e9-96e7728a3270 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:48.202670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 274/560] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:48.208020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3013a7-c302-421e-a851-8bb867e1da70 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:48.258373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d31874-cf58-47a2-b6e9-96e7728a3270 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:48.312506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:48.352906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3013a7-c302-421e-a851-8bb867e1da70 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:48.392374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953aef6a-82b1-4a91-a86a-8d394d84377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:48.392947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953aef6a-82b1-4a91-a86a-8d394d84377a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:48.393229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953aef6a-82b1-4a91-a86a-8d394d84377a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:48.393502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953aef6a-82b1-4a91-a86a-8d394d84377a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:48.400850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953aef6a-82b1-4a91-a86a-8d394d84377a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:48.402316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953aef6a-82b1-4a91-a86a-8d394d84377a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-953aef6a-82b1-4a91-a86a-8d394d84377a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:48.422770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:48.423739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:48.424611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:48.424611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:48.424611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:48.424611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:48.424611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:48.424611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:48.424611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:48.424611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:48.427982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 287/561] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:48.431809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953aef6a-82b1-4a91-a86a-8d394d84377a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:48.451190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d31874-cf58-47a2-b6e9-96e7728a3270 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:48.507594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76d7f0-0006-4ef6-8970-e06ccd795d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:48.508262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76d7f0-0006-4ef6-8970-e06ccd795d6a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:48.508856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76d7f0-0006-4ef6-8970-e06ccd795d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:48.508856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76d7f0-0006-4ef6-8970-e06ccd795d6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:48.522654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:48.529101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76d7f0-0006-4ef6-8970-e06ccd795d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-fa76d7f0-0006-4ef6-8970-e06ccd795d6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:48.534572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:48.535587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:48.536435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 275/562] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:48.543723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76d7f0-0006-4ef6-8970-e06ccd795d6a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:48.601898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953aef6a-82b1-4a91-a86a-8d394d84377a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:48.680427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7220-8909-46d2-b150-b6748181e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:48.681054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7220-8909-46d2-b150-b6748181e625 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:48.681220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7220-8909-46d2-b150-b6748181e625 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:48.681485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a7220-8909-46d2-b150-b6748181e625 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:48.682181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a7220-8909-46d2-b150-b6748181e625 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:48.682484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a7220-8909-46d2-b150-b6748181e625 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:48.683931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a7220-8909-46d2-b150-b6748181e625 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:48.703456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76d7f0-0006-4ef6-8970-e06ccd795d6a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:48.704338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:48.708880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 288/563] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:48.712480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7220-8909-46d2-b150-b6748181e625 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:48.740996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c319e5-0943-4f39-bc6f-e4d0e60ef21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:48.741927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c319e5-0943-4f39-bc6f-e4d0e60ef21d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:48.742387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c319e5-0943-4f39-bc6f-e4d0e60ef21d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:48.742969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c319e5-0943-4f39-bc6f-e4d0e60ef21d None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:48.743872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c319e5-0943-4f39-bc6f-e4d0e60ef21d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:48.744529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c319e5-0943-4f39-bc6f-e4d0e60ef21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:48.746121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c319e5-0943-4f39-bc6f-e4d0e60ef21d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:48.767537 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 276/564] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:48.782704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c319e5-0943-4f39-bc6f-e4d0e60ef21d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:48.856342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:48.876012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a7220-8909-46d2-b150-b6748181e625 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:48.902012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c319e5-0943-4f39-bc6f-e4d0e60ef21d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:48.938540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b465f-4bc2-455a-8292-2d24aa45cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:48.939584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b465f-4bc2-455a-8292-2d24aa45cdcf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:48.940066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b465f-4bc2-455a-8292-2d24aa45cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:48.940538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b465f-4bc2-455a-8292-2d24aa45cdcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:48.944371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51d5f8-210d-4359-af3a-0ac56c26183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:48.945052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51d5f8-210d-4359-af3a-0ac56c26183e None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:48.945332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51d5f8-210d-4359-af3a-0ac56c26183e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:48.945611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51d5f8-210d-4359-af3a-0ac56c26183e None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/b38639ab90e5439a990cf603c627dab3/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:48.952000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51d5f8-210d-4359-af3a-0ac56c26183e None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=b38639ab90e5439a990cf603c627dab3, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:48.952907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b465f-4bc2-455a-8292-2d24aa45cdcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:48.953442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51d5f8-210d-4359-af3a-0ac56c26183e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:48.954866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b465f-4bc2-455a-8292-2d24aa45cdcf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7c1b465f-4bc2-455a-8292-2d24aa45cdcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:48.971287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:48.972422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:48.973332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:48.973332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:48.973332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:48.975660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 277/565] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:48.977141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef813-f221-4017-a584-10651e357334 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:48.977661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef813-f221-4017-a584-10651e357334 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:48.978129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef813-f221-4017-a584-10651e357334 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:48.979870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 278/566] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:48.981642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef813-f221-4017-a584-10651e357334 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:48.990430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 289/567] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:48 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/b38639ab90e5439a990cf603c627dab3/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:11:48.990430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372241f9-077a-474e-9c0d-c6314b08839a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:48.990430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372241f9-077a-474e-9c0d-c6314b08839a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:48.990430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372241f9-077a-474e-9c0d-c6314b08839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:49.043918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-372241f9-077a-474e-9c0d-c6314b08839a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:49.045185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-372241f9-077a-474e-9c0d-c6314b08839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:49.132819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef813-f221-4017-a584-10651e357334 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:49.153541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:49.163706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:49.185995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 290/568] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:49.214168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432e083-f0dd-48c3-b9d5-6588bd2d9622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:49.214843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432e083-f0dd-48c3-b9d5-6588bd2d9622 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:49.215130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432e083-f0dd-48c3-b9d5-6588bd2d9622 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:49.215404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432e083-f0dd-48c3-b9d5-6588bd2d9622 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:49.216071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432e083-f0dd-48c3-b9d5-6588bd2d9622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:49.216379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432e083-f0dd-48c3-b9d5-6588bd2d9622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:49.217788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432e083-f0dd-48c3-b9d5-6588bd2d9622 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:49.235148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 279/569] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:49.240530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372241f9-077a-474e-9c0d-c6314b08839a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:49.343651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372241f9-077a-474e-9c0d-c6314b08839a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:49.383281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3fcf2-e121-4634-b244-673f80401d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:49.384034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3fcf2-e121-4634-b244-673f80401d69 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:49.384313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3fcf2-e121-4634-b244-673f80401d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:49.384584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3fcf2-e121-4634-b244-673f80401d69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:49.392128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3fcf2-e121-4634-b244-673f80401d69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:49.393663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3fcf2-e121-4634-b244-673f80401d69 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-f6b3fcf2-e121-4634-b244-673f80401d69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:49.405360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:49.406406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:11:49.407439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:49.410865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 291/570] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Oct 27 01:11:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:49.412617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432e083-f0dd-48c3-b9d5-6588bd2d9622 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:49.485926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3fcf2-e121-4634-b244-673f80401d69 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:49.565924 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432e083-f0dd-48c3-b9d5-6588bd2d9622 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:49.567066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:49.630432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d32b2e-fbfa-436d-a591-1d5620957c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:49.631076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d32b2e-fbfa-436d-a591-1d5620957c8c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:49.631354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d32b2e-fbfa-436d-a591-1d5620957c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:49.631626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d32b2e-fbfa-436d-a591-1d5620957c8c None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:49.632365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d32b2e-fbfa-436d-a591-1d5620957c8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:49.632664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d32b2e-fbfa-436d-a591-1d5620957c8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:49.634140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d32b2e-fbfa-436d-a591-1d5620957c8c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:49.653004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3fcf2-e121-4634-b244-673f80401d69 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:49.675378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 280/571] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Oct 27 01:11:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:49.679025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d32b2e-fbfa-436d-a591-1d5620957c8c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:49.726032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac91b8-f446-48c6-b12f-8aff75824955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:49.727032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac91b8-f446-48c6-b12f-8aff75824955 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:49.727339 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac91b8-f446-48c6-b12f-8aff75824955 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:49.727657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac91b8-f446-48c6-b12f-8aff75824955 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:49.728260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac91b8-f446-48c6-b12f-8aff75824955 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:49.728786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:49.729636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac91b8-f446-48c6-b12f-8aff75824955 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-99ac91b8-f446-48c6-b12f-8aff75824955 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:49.748342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:49.749394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:11:49.750282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:49.751951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 292/572] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Oct 27 01:11:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:49.762875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac91b8-f446-48c6-b12f-8aff75824955 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:49.817422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d32b2e-fbfa-436d-a591-1d5620957c8c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:49.855291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119aeaa-d6b7-4370-8652-dc43702695ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:49.856367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119aeaa-d6b7-4370-8652-dc43702695ee None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:49.856917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119aeaa-d6b7-4370-8652-dc43702695ee None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:49.857187 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119aeaa-d6b7-4370-8652-dc43702695ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:49.936282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119aeaa-d6b7-4370-8652-dc43702695ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:49.937912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119aeaa-d6b7-4370-8652-dc43702695ee None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:49.971578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:50.053755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 281/573] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:11:50.060797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119aeaa-d6b7-4370-8652-dc43702695ee None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:50.065011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac91b8-f446-48c6-b12f-8aff75824955 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:50.083075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:50.133873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dba14-9472-4e5f-88ce-c089b4543abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:50.134520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dba14-9472-4e5f-88ce-c089b4543abb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.134823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dba14-9472-4e5f-88ce-c089b4543abb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.135099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dba14-9472-4e5f-88ce-c089b4543abb None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.135751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dba14-9472-4e5f-88ce-c089b4543abb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:50.136056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dba14-9472-4e5f-88ce-c089b4543abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:50.137784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dba14-9472-4e5f-88ce-c089b4543abb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:50.149277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 293/574] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Oct 27 01:11:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:50.156513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dba14-9472-4e5f-88ce-c089b4543abb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:50.193410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119aeaa-d6b7-4370-8652-dc43702695ee None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:50.224508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:50.232966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be549-f74f-42d2-b9aa-a3dd741b0ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:50.233609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be549-f74f-42d2-b9aa-a3dd741b0ebe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.233885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be549-f74f-42d2-b9aa-a3dd741b0ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.234154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be549-f74f-42d2-b9aa-a3dd741b0ebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.245181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be549-f74f-42d2-b9aa-a3dd741b0ebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:50.246678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be549-f74f-42d2-b9aa-a3dd741b0ebe None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b02be549-f74f-42d2-b9aa-a3dd741b0ebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:50.262226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:50.263614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:50.264528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:50.264528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:50.264528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:50.264528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 282/575] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:50.270084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be549-f74f-42d2-b9aa-a3dd741b0ebe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:50.320797 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dba14-9472-4e5f-88ce-c089b4543abb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:50.355338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041756bd-ffd6-4457-9015-24cba187ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:50.355956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041756bd-ffd6-4457-9015-24cba187ca73 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.356229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041756bd-ffd6-4457-9015-24cba187ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.356500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041756bd-ffd6-4457-9015-24cba187ca73 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.357229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041756bd-ffd6-4457-9015-24cba187ca73 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:50.357532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041756bd-ffd6-4457-9015-24cba187ca73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:50.359013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041756bd-ffd6-4457-9015-24cba187ca73 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:50.364200 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 294/576] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Oct 27 01:11:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:50.365464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0e87-6dd1-4d9e-ac09-0ac5bb881e1d None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.365816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0e87-6dd1-4d9e-ac09-0ac5bb881e1d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.366100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0e87-6dd1-4d9e-ac09-0ac5bb881e1d None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.371819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 295/577] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:50.372927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af0e87-6dd1-4d9e-ac09-0ac5bb881e1d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:50.416734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be549-f74f-42d2-b9aa-a3dd741b0ebe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:50.420050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:50.458353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd50760-f727-47e6-b263-9b1a10a297b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:50.459109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd50760-f727-47e6-b263-9b1a10a297b5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.459383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd50760-f727-47e6-b263-9b1a10a297b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.459656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd50760-f727-47e6-b263-9b1a10a297b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.460282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd50760-f727-47e6-b263-9b1a10a297b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:50.460582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd50760-f727-47e6-b263-9b1a10a297b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:50.462373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd50760-f727-47e6-b263-9b1a10a297b5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:50.478887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 283/578] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:50.480849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e5300-7f58-4c50-a51b-3da48e7e91cc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.481283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e5300-7f58-4c50-a51b-3da48e7e91cc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.481612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e5300-7f58-4c50-a51b-3da48e7e91cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.481714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af0e87-6dd1-4d9e-ac09-0ac5bb881e1d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:50.501354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-037e5300-7f58-4c50-a51b-3da48e7e91cc None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:50.502532 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-037e5300-7f58-4c50-a51b-3da48e7e91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:50.516680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7a9c-a599-4dea-bccf-61d60861c062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:50.517623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7a9c-a599-4dea-bccf-61d60861c062 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.517623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7a9c-a599-4dea-bccf-61d60861c062 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.517877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7a9c-a599-4dea-bccf-61d60861c062 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.518548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7a9c-a599-4dea-bccf-61d60861c062 None admin] RBAC: Adding query filter params (interface=public, service_id=49f1e9ee38ba4425882b87dd652c109c, region_id=RegionOne) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:50.518899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7a9c-a599-4dea-bccf-61d60861c062 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:50.520256 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7a9c-a599-4dea-bccf-61d60861c062 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:50.528187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 296/579] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Oct 27 01:11:50 2022] GET /identity/v3/endpoints?service_id=49f1e9ee38ba4425882b87dd652c109c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:50.529429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f720d4-88a7-4d19-b85a-4d48815af47f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.529718 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f720d4-88a7-4d19-b85a-4d48815af47f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.529997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f720d4-88a7-4d19-b85a-4d48815af47f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.535299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 297/580] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:50.536062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f720d4-88a7-4d19-b85a-4d48815af47f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:50.552773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:50.590826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 284/581] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:50.590826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e5300-7f58-4c50-a51b-3da48e7e91cc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:50.674518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f720d4-88a7-4d19-b85a-4d48815af47f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:50.677784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:50.698108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e5300-7f58-4c50-a51b-3da48e7e91cc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:50.721250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009f133-6c52-4f7b-a49c-0dbab9c61b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:50.721907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f133-6c52-4f7b-a49c-0dbab9c61b65 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.722336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f133-6c52-4f7b-a49c-0dbab9c61b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.722619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f133-6c52-4f7b-a49c-0dbab9c61b65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.731567 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009f133-6c52-4f7b-a49c-0dbab9c61b65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:50.733235 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009f133-6c52-4f7b-a49c-0dbab9c61b65 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:50.734237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111ef9f-3244-4fdf-a7d2-868f212145e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:50.734981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ef9f-3244-4fdf-a7d2-868f212145e8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.735328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ef9f-3244-4fdf-a7d2-868f212145e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.735715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ef9f-3244-4fdf-a7d2-868f212145e8 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.736438 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111ef9f-3244-4fdf-a7d2-868f212145e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:50.737849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111ef9f-3244-4fdf-a7d2-868f212145e8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-2009f133-6c52-4f7b-a49c-0dbab9c61b65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:50.745384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:50.746260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 298/582] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816f123-d79f-43e4-981a-915fbd33f8b0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:50.748371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816f123-d79f-43e4-981a-915fbd33f8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:50.749739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816f123-d79f-43e4-981a-915fbd33f8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:50.754754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 285/583] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Oct 27 01:11:50 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:50.756656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111ef9f-3244-4fdf-a7d2-868f212145e8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:50.773915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7816f123-d79f-43e4-981a-915fbd33f8b0 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:50.775237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7816f123-d79f-43e4-981a-915fbd33f8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:50.858113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:50.892288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 299/584] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:50.894910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816f123-d79f-43e4-981a-915fbd33f8b0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:50.972000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111ef9f-3244-4fdf-a7d2-868f212145e8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:51.020928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c25358-11ea-4fc5-a57c-150ff2a40be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:51.021954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c25358-11ea-4fc5-a57c-150ff2a40be0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.022439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c25358-11ea-4fc5-a57c-150ff2a40be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.023119 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c25358-11ea-4fc5-a57c-150ff2a40be0 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.024516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c25358-11ea-4fc5-a57c-150ff2a40be0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:51.025263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c25358-11ea-4fc5-a57c-150ff2a40be0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:51.027168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c25358-11ea-4fc5-a57c-150ff2a40be0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:51.037024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:51.046396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 286/585] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:51.053196 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c25358-11ea-4fc5-a57c-150ff2a40be0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:51.055907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816f123-d79f-43e4-981a-915fbd33f8b0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:51.100576 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f8c2d-a7d4-4f24-804b-138c14e90ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:51.101480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f8c2d-a7d4-4f24-804b-138c14e90ffa None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.102102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f8c2d-a7d4-4f24-804b-138c14e90ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.102564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f8c2d-a7d4-4f24-804b-138c14e90ffa None admin] PATH_INFO: `/v3/services/network` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.107489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f8c2d-a7d4-4f24-804b-138c14e90ffa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:51.109048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f8c2d-a7d4-4f24-804b-138c14e90ffa None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-996f8c2d-a7d4-4f24-804b-138c14e90ffa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:51.127899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:51.129214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:11:51.130321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:51.133717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 300/586] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:50 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:51.138749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f8c2d-a7d4-4f24-804b-138c14e90ffa None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:51.222575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:51.226303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c25358-11ea-4fc5-a57c-150ff2a40be0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:51.265232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251b40-9c97-44f7-9382-c7785ab267f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:51.265746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251b40-9c97-44f7-9382-c7785ab267f0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.266027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251b40-9c97-44f7-9382-c7785ab267f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.266301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251b40-9c97-44f7-9382-c7785ab267f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.267067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251b40-9c97-44f7-9382-c7785ab267f0 None admin] RBAC: Adding query filter params (role.id=72129dcc28d546169fd012284e4019ec, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=8af81f74f98b478ab71c0b22b365e3da) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:51.267568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251b40-9c97-44f7-9382-c7785ab267f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:51.268800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251b40-9c97-44f7-9382-c7785ab267f0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:51.282766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 287/587] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:51 2022] GET /identity/v3/role_assignments?user.id=8af81f74f98b478ab71c0b22b365e3da&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=72129dcc28d546169fd012284e4019ec => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:51.282766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251b40-9c97-44f7-9382-c7785ab267f0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:51.302998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f8c2d-a7d4-4f24-804b-138c14e90ffa None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:51.400293 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47a134-7b47-499c-8800-a88e5acb9c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:51.400901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47a134-7b47-499c-8800-a88e5acb9c40 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.401134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47a134-7b47-499c-8800-a88e5acb9c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.401405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47a134-7b47-499c-8800-a88e5acb9c40 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.402054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47a134-7b47-499c-8800-a88e5acb9c40 None admin] RBAC: Adding query filter params (name=network) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:51.402358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47a134-7b47-499c-8800-a88e5acb9c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:51.403764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47a134-7b47-499c-8800-a88e5acb9c40 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:51.420891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 301/588] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:11:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:51.426504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47a134-7b47-499c-8800-a88e5acb9c40 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:51.439079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251b40-9c97-44f7-9382-c7785ab267f0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:51.487059 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05ac92-1a3b-4e8b-8ab6-6cb2cc586e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:51.487815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ac92-1a3b-4e8b-8ab6-6cb2cc586e1c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.488104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ac92-1a3b-4e8b-8ab6-6cb2cc586e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.488386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ac92-1a3b-4e8b-8ab6-6cb2cc586e1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.494118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:51.502424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05ac92-1a3b-4e8b-8ab6-6cb2cc586e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7f05ac92-1a3b-4e8b-8ab6-6cb2cc586e1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:51.508276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:51.509321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:51.510345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 288/589] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:51.511767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63a7f4-dc14-4f59-bf01-f5a073c30c92 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.512116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63a7f4-dc14-4f59-bf01-f5a073c30c92 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.512815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63a7f4-dc14-4f59-bf01-f5a073c30c92 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.514127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 289/590] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:51.519568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63a7f4-dc14-4f59-bf01-f5a073c30c92 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:51.550963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:51.595382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47a134-7b47-499c-8800-a88e5acb9c40 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:51.635485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63a7f4-dc14-4f59-bf01-f5a073c30c92 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:51.644857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0733e5-6ad7-44ad-90ab-f816da9d9a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:51.645743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0733e5-6ad7-44ad-90ab-f816da9d9a16 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.646685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0733e5-6ad7-44ad-90ab-f816da9d9a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.647174 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0733e5-6ad7-44ad-90ab-f816da9d9a16 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.648604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0733e5-6ad7-44ad-90ab-f816da9d9a16 None admin] RBAC: Adding query filter params (type=network) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:51.649255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0733e5-6ad7-44ad-90ab-f816da9d9a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:51.651089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0733e5-6ad7-44ad-90ab-f816da9d9a16 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:51.658567 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 302/591] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:11:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:51.660581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba32fa-e61c-4d46-aefb-46900b8c8271 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.661186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba32fa-e61c-4d46-aefb-46900b8c8271 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.661599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba32fa-e61c-4d46-aefb-46900b8c8271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.673097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea84bf-8b9a-4f4e-9834-39ace2633e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:51.673954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea84bf-8b9a-4f4e-9834-39ace2633e2a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.674384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea84bf-8b9a-4f4e-9834-39ace2633e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.674833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea84bf-8b9a-4f4e-9834-39ace2633e2a None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.675633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea84bf-8b9a-4f4e-9834-39ace2633e2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:51.676070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea84bf-8b9a-4f4e-9834-39ace2633e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:51.678131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea84bf-8b9a-4f4e-9834-39ace2633e2a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:51.682772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d1ba32fa-e61c-4d46-aefb-46900b8c8271 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:51.684152 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d1ba32fa-e61c-4d46-aefb-46900b8c8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:51.689820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 290/592] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:11:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:51.690947 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea84bf-8b9a-4f4e-9834-39ace2633e2a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:51.758891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 303/593] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:51.760013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba32fa-e61c-4d46-aefb-46900b8c8271 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:51.799913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:51.801115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:51.823547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea84bf-8b9a-4f4e-9834-39ace2633e2a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:51.890982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d34af0-cb5f-4866-b794-6138e762ab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:51.891609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d34af0-cb5f-4866-b794-6138e762ab18 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:51.891889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d34af0-cb5f-4866-b794-6138e762ab18 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:51.892164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d34af0-cb5f-4866-b794-6138e762ab18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:51.892874 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d34af0-cb5f-4866-b794-6138e762ab18 None admin] RBAC: Adding query filter params (interface=public, service_id=7a342f459bab453c9ffc0984d38e97a1, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:51.893931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d34af0-cb5f-4866-b794-6138e762ab18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:51.895356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d34af0-cb5f-4866-b794-6138e762ab18 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:51.909854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 291/594] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Oct 27 01:11:51 2022] GET /identity/v3/endpoints?service_id=7a342f459bab453c9ffc0984d38e97a1&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:51.913988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d34af0-cb5f-4866-b794-6138e762ab18 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:51.966412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba32fa-e61c-4d46-aefb-46900b8c8271 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:52.034881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed685c-0415-4ad8-8152-a669a24ccb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:52.035534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed685c-0415-4ad8-8152-a669a24ccb7b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:52.035861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed685c-0415-4ad8-8152-a669a24ccb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:52.036139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed685c-0415-4ad8-8152-a669a24ccb7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:52.059120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed685c-0415-4ad8-8152-a669a24ccb7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:52.060595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed685c-0415-4ad8-8152-a669a24ccb7b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:52.080958 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d34af0-cb5f-4866-b794-6138e762ab18 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-91ed685c-0415-4ad8-8152-a669a24ccb7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:52.085094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:52.086017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:52.087071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:52.087071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:52.087071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:52.087071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 304/595] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:52.092419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed685c-0415-4ad8-8152-a669a24ccb7b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:52.119332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e701-a567-4f2a-a545-b5cbd04c733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:52.119953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e701-a567-4f2a-a545-b5cbd04c733a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:52.120239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e701-a567-4f2a-a545-b5cbd04c733a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:52.120517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e701-a567-4f2a-a545-b5cbd04c733a None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:52.121133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1e701-a567-4f2a-a545-b5cbd04c733a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:52.122510 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1e701-a567-4f2a-a545-b5cbd04c733a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:52.128372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 292/596] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Oct 27 01:11:51 2022] GET /identity/v3/services => generated 772 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:52.129174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e701-a567-4f2a-a545-b5cbd04c733a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:52.165642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:52.177307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:52.220191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed685c-0415-4ad8-8152-a669a24ccb7b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:52.260429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b165443-9182-4873-90df-be9d50f1f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:52.261660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b165443-9182-4873-90df-be9d50f1f647 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:52.262142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b165443-9182-4873-90df-be9d50f1f647 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:52.263033 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b165443-9182-4873-90df-be9d50f1f647 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:52.263908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b165443-9182-4873-90df-be9d50f1f647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:52.264464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b165443-9182-4873-90df-be9d50f1f647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:52.266094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b165443-9182-4873-90df-be9d50f1f647 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:52.288841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 305/597] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:52.299993 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b165443-9182-4873-90df-be9d50f1f647 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:52.332738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e701-a567-4f2a-a545-b5cbd04c733a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:52.379940 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60634ae7-7daf-4fa0-830c-6f59afd99fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:52.381063 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60634ae7-7daf-4fa0-830c-6f59afd99fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:52.381368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60634ae7-7daf-4fa0-830c-6f59afd99fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:52.381647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60634ae7-7daf-4fa0-830c-6f59afd99fb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:52.407739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60634ae7-7daf-4fa0-830c-6f59afd99fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-60634ae7-7daf-4fa0-830c-6f59afd99fb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:52.416847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:52.417926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:11:52.418911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:52.419697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 293/598] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:52.428660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60634ae7-7daf-4fa0-830c-6f59afd99fb3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:52.490107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b165443-9182-4873-90df-be9d50f1f647 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:52.517857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:52.521093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:52.530458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251a4d7-03d0-49d0-a9bb-1b953dd1e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:52.530990 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251a4d7-03d0-49d0-a9bb-1b953dd1e560 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:52.532285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251a4d7-03d0-49d0-a9bb-1b953dd1e560 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:52.532760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251a4d7-03d0-49d0-a9bb-1b953dd1e560 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:52.541201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251a4d7-03d0-49d0-a9bb-1b953dd1e560 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:52.542786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251a4d7-03d0-49d0-a9bb-1b953dd1e560 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-b251a4d7-03d0-49d0-a9bb-1b953dd1e560 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:52.556512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:52.557729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:11:52.558991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:52.560303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 306/599] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Oct 27 01:11:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:52.561317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60634ae7-7daf-4fa0-830c-6f59afd99fb3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:52.571392 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251a4d7-03d0-49d0-a9bb-1b953dd1e560 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:52.603280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c08c89-e2d2-4655-9cf4-09e72a7c392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:52.603663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c08c89-e2d2-4655-9cf4-09e72a7c392d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:52.603968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c08c89-e2d2-4655-9cf4-09e72a7c392d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:52.604249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c08c89-e2d2-4655-9cf4-09e72a7c392d None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:52.604924 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c08c89-e2d2-4655-9cf4-09e72a7c392d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:52.605231 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c08c89-e2d2-4655-9cf4-09e72a7c392d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:52.606603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c08c89-e2d2-4655-9cf4-09e72a7c392d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:52.616784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 294/600] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:11:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:52.624817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c08c89-e2d2-4655-9cf4-09e72a7c392d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:52.700373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251a4d7-03d0-49d0-a9bb-1b953dd1e560 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:52.740425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18df5a5-dcb2-4350-8edb-9b66a7c55928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:52.741479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18df5a5-dcb2-4350-8edb-9b66a7c55928 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:52.741969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18df5a5-dcb2-4350-8edb-9b66a7c55928 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:52.742443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18df5a5-dcb2-4350-8edb-9b66a7c55928 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:52.743505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18df5a5-dcb2-4350-8edb-9b66a7c55928 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:52.744348 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18df5a5-dcb2-4350-8edb-9b66a7c55928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:52.746302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18df5a5-dcb2-4350-8edb-9b66a7c55928 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:52.768681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 307/601] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Oct 27 01:11:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:52.775414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18df5a5-dcb2-4350-8edb-9b66a7c55928 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:52.828872 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:52.829834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c08c89-e2d2-4655-9cf4-09e72a7c392d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:52.895578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18df5a5-dcb2-4350-8edb-9b66a7c55928 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:52.907547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b256f9f-add7-4c67-b701-596d7a0de3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:52.908197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b256f9f-add7-4c67-b701-596d7a0de3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:52.908481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b256f9f-add7-4c67-b701-596d7a0de3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:52.908747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b256f9f-add7-4c67-b701-596d7a0de3a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:52.910839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:52.935739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b256f9f-add7-4c67-b701-596d7a0de3a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:52.936217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a81b-7641-4326-9c32-55ce7d23ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:52.937105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a81b-7641-4326-9c32-55ce7d23ba1f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:52.937241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b256f9f-add7-4c67-b701-596d7a0de3a6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:52.937653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a81b-7641-4326-9c32-55ce7d23ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:52.938077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a81b-7641-4326-9c32-55ce7d23ba1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9b256f9f-add7-4c67-b701-596d7a0de3a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:52.965079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:52.966283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:52.967420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:52.967420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:52.967420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:52.974868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 295/602] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:52.983816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b256f9f-add7-4c67-b701-596d7a0de3a6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:53.019919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651a81b-7641-4326-9c32-55ce7d23ba1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:53.021757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651a81b-7641-4326-9c32-55ce7d23ba1f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:53.075157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:53.132990 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 308/603] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:11:53.139676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a81b-7641-4326-9c32-55ce7d23ba1f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:53.223653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b256f9f-add7-4c67-b701-596d7a0de3a6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:53.249103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a81b-7641-4326-9c32-55ce7d23ba1f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:53.259068 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92065d6-cdb7-41be-9385-e0ef94537f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:53.260000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92065d6-cdb7-41be-9385-e0ef94537f0f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.260479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92065d6-cdb7-41be-9385-e0ef94537f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.260944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92065d6-cdb7-41be-9385-e0ef94537f0f None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.261821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92065d6-cdb7-41be-9385-e0ef94537f0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:53.262322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92065d6-cdb7-41be-9385-e0ef94537f0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:53.264289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92065d6-cdb7-41be-9385-e0ef94537f0f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:53.277142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 296/604] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:53.283318 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411ce49-f4b0-4ca3-addc-ead40453e160 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.283857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411ce49-f4b0-4ca3-addc-ead40453e160 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.284330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411ce49-f4b0-4ca3-addc-ead40453e160 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.286050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 297/605] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:53.286977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411ce49-f4b0-4ca3-addc-ead40453e160 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:53.290663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01746cb-4758-43e7-a4c6-bfade2cca17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:53.291341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01746cb-4758-43e7-a4c6-bfade2cca17b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.291618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01746cb-4758-43e7-a4c6-bfade2cca17b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.291904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01746cb-4758-43e7-a4c6-bfade2cca17b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.304325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01746cb-4758-43e7-a4c6-bfade2cca17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:53.306416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01746cb-4758-43e7-a4c6-bfade2cca17b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-f01746cb-4758-43e7-a4c6-bfade2cca17b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:53.322084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:53.323106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:53.323984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:53.323984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:53.323984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:53.326791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 309/606] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:11:53.327077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:53.331362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819979-f158-4aaf-bf58-be46da481019 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.333793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819979-f158-4aaf-bf58-be46da481019 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.334881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819979-f158-4aaf-bf58-be46da481019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.355388 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:53.361821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-16819979-f158-4aaf-bf58-be46da481019 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:53.364823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-16819979-f158-4aaf-bf58-be46da481019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:53.419162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411ce49-f4b0-4ca3-addc-ead40453e160 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:53.446838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 310/607] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:53.446838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16819979-f158-4aaf-bf58-be46da481019 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:53.472542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7525b-c616-44d7-8f26-1d7563d3755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:53.473641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7525b-c616-44d7-8f26-1d7563d3755c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.474205 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7525b-c616-44d7-8f26-1d7563d3755c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.474708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7525b-c616-44d7-8f26-1d7563d3755c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.490342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7525b-c616-44d7-8f26-1d7563d3755c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:53.492232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7525b-c616-44d7-8f26-1d7563d3755c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ece7525b-c616-44d7-8f26-1d7563d3755c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:53.514498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:53.515622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:11:53.516559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:53.519136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 298/608] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:11:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:53.527756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7525b-c616-44d7-8f26-1d7563d3755c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:53.548949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16819979-f158-4aaf-bf58-be46da481019 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:53.582743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:53.591875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7abae-deb0-435e-858b-df69db3c98ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:53.592864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7abae-deb0-435e-858b-df69db3c98ec None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.594391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7abae-deb0-435e-858b-df69db3c98ec None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.594391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7abae-deb0-435e-858b-df69db3c98ec None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.594391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7abae-deb0-435e-858b-df69db3c98ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:53.594639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7abae-deb0-435e-858b-df69db3c98ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:53.600043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7abae-deb0-435e-858b-df69db3c98ec None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:53.632996 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 311/609] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:53.647733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7abae-deb0-435e-858b-df69db3c98ec None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:53.680271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7525b-c616-44d7-8f26-1d7563d3755c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:53.688226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:53.720626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55e698-58c6-49e9-b187-7ffd04a96b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:53.722168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e698-58c6-49e9-b187-7ffd04a96b4a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.723502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e698-58c6-49e9-b187-7ffd04a96b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.723777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e698-58c6-49e9-b187-7ffd04a96b4a None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.724569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55e698-58c6-49e9-b187-7ffd04a96b4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:53.724818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55e698-58c6-49e9-b187-7ffd04a96b4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:53.729440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55e698-58c6-49e9-b187-7ffd04a96b4a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:53.752113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 299/610] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Oct 27 01:11:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:53.759774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55e698-58c6-49e9-b187-7ffd04a96b4a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:53.847561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7abae-deb0-435e-858b-df69db3c98ec None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:53.889863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ee396-9df8-4d26-9a39-df716ecbb50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:53.890648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ee396-9df8-4d26-9a39-df716ecbb50b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.891197 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ee396-9df8-4d26-9a39-df716ecbb50b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.891672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ee396-9df8-4d26-9a39-df716ecbb50b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.900286 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ee396-9df8-4d26-9a39-df716ecbb50b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:53.902023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ee396-9df8-4d26-9a39-df716ecbb50b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:53.910688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55e698-58c6-49e9-b187-7ffd04a96b4a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-f76ee396-9df8-4d26-9a39-df716ecbb50b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:53.916531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:53.917464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:53.918357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:53.918357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:53.918357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:53.918357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:53.918357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:53.918357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:53.918357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:53.918357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:53.922684 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 312/611] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:53.923439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ee396-9df8-4d26-9a39-df716ecbb50b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:53.951275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235c37a-007c-4dc0-b358-dbd25a0e8ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:53.951902 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c37a-007c-4dc0-b358-dbd25a0e8ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.952160 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c37a-007c-4dc0-b358-dbd25a0e8ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.952426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c37a-007c-4dc0-b358-dbd25a0e8ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.975504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:53.984726 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:54.030401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ee396-9df8-4d26-9a39-df716ecbb50b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.031980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235c37a-007c-4dc0-b358-dbd25a0e8ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.034221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235c37a-007c-4dc0-b358-dbd25a0e8ff1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.065812 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a7a31-1200-4601-b5f8-40cba0efac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:54.066455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a7a31-1200-4601-b5f8-40cba0efac2a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.066928 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a7a31-1200-4601-b5f8-40cba0efac2a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.067191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a7a31-1200-4601-b5f8-40cba0efac2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.068131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a7a31-1200-4601-b5f8-40cba0efac2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.069750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a7a31-1200-4601-b5f8-40cba0efac2a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-4d3a7a31-1200-4601-b5f8-40cba0efac2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:54.080455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:54.081696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:11:54.082543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:54.086891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 313/612] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Oct 27 01:11:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:54.088467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f13ab2-d54b-49a9-9de4-0e7ca025ea21 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.088980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f13ab2-d54b-49a9-9de4-0e7ca025ea21 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.089260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f13ab2-d54b-49a9-9de4-0e7ca025ea21 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.090702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 314/613] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:54.095361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f13ab2-d54b-49a9-9de4-0e7ca025ea21 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:54.157998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 300/614] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:11:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:11:54.157998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235c37a-007c-4dc0-b358-dbd25a0e8ff1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:54.205925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f13ab2-d54b-49a9-9de4-0e7ca025ea21 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.220488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:54.221419 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:54.247646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df904da2-4de4-4a11-9533-d65a0561f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:54.248178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df904da2-4de4-4a11-9533-d65a0561f63b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.248481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df904da2-4de4-4a11-9533-d65a0561f63b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.248808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df904da2-4de4-4a11-9533-d65a0561f63b None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.249449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df904da2-4de4-4a11-9533-d65a0561f63b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:54.249751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df904da2-4de4-4a11-9533-d65a0561f63b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.251952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df904da2-4de4-4a11-9533-d65a0561f63b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.259370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235c37a-007c-4dc0-b358-dbd25a0e8ff1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.269266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 315/615] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:54.271208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af474-5e27-4544-861a-2dd55c23c11e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.272125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af474-5e27-4544-861a-2dd55c23c11e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.272856 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af474-5e27-4544-861a-2dd55c23c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.292725 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-894af474-5e27-4544-861a-2dd55c23c11e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:54.294037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-894af474-5e27-4544-861a-2dd55c23c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:54.297389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5f96c-6dba-4b01-8b30-c3fc2dc33e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:54.297922 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5f96c-6dba-4b01-8b30-c3fc2dc33e76 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.298203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5f96c-6dba-4b01-8b30-c3fc2dc33e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.298534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5f96c-6dba-4b01-8b30-c3fc2dc33e76 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.299217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5f96c-6dba-4b01-8b30-c3fc2dc33e76 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:54.299570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5f96c-6dba-4b01-8b30-c3fc2dc33e76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.300933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5f96c-6dba-4b01-8b30-c3fc2dc33e76 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.310991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 301/616] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Oct 27 01:11:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:54.310991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5f96c-6dba-4b01-8b30-c3fc2dc33e76 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:54.370629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 316/617] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:54.371778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894af474-5e27-4544-861a-2dd55c23c11e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:54.427787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5f96c-6dba-4b01-8b30-c3fc2dc33e76 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.455656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:54.465082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76276b09-cc44-4ccd-a0cb-c7b5b8c593ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:54.465861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76276b09-cc44-4ccd-a0cb-c7b5b8c593ee None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.466242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76276b09-cc44-4ccd-a0cb-c7b5b8c593ee None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.466624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76276b09-cc44-4ccd-a0cb-c7b5b8c593ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.477599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76276b09-cc44-4ccd-a0cb-c7b5b8c593ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.479211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76276b09-cc44-4ccd-a0cb-c7b5b8c593ee None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.484870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894af474-5e27-4544-861a-2dd55c23c11e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.486539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-76276b09-cc44-4ccd-a0cb-c7b5b8c593ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:54.495383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:54.496639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:54.497826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:54.497826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:54.497826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:54.499035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 302/618] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:54.500153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76276b09-cc44-4ccd-a0cb-c7b5b8c593ee None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:54.527111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033f92e-7908-4a82-b664-f61f8597f47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:54.528103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033f92e-7908-4a82-b664-f61f8597f47e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.528537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033f92e-7908-4a82-b664-f61f8597f47e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.528952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033f92e-7908-4a82-b664-f61f8597f47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.529899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033f92e-7908-4a82-b664-f61f8597f47e None admin] RBAC: Adding query filter params (role.id=70b64fc972514149806cf9aeb00c7ce1, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=22b2d94a0f0c442688ef74359536281e) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:54.530472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033f92e-7908-4a82-b664-f61f8597f47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.532175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033f92e-7908-4a82-b664-f61f8597f47e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.547106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 317/619] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:54 2022] GET /identity/v3/role_assignments?user.id=22b2d94a0f0c442688ef74359536281e&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=70b64fc972514149806cf9aeb00c7ce1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:54.548472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033f92e-7908-4a82-b664-f61f8597f47e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:54.614751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76276b09-cc44-4ccd-a0cb-c7b5b8c593ee None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.653889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c8826-f990-4811-b429-e180420b0b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:54.654619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c8826-f990-4811-b429-e180420b0b8f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.654994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c8826-f990-4811-b429-e180420b0b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.655340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c8826-f990-4811-b429-e180420b0b8f None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.656061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c8826-f990-4811-b429-e180420b0b8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:54.656820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c8826-f990-4811-b429-e180420b0b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.658141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c8826-f990-4811-b429-e180420b0b8f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.663983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 303/620] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Oct 27 01:11:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:54.664926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c8826-f990-4811-b429-e180420b0b8f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:54.714014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:54.717970 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033f92e-7908-4a82-b664-f61f8597f47e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.756145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74acad0-6624-4a2d-965d-82b4c6c33dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:54.756675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74acad0-6624-4a2d-965d-82b4c6c33dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.756947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74acad0-6624-4a2d-965d-82b4c6c33dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.757214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74acad0-6624-4a2d-965d-82b4c6c33dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.757869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74acad0-6624-4a2d-965d-82b4c6c33dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:54.758167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74acad0-6624-4a2d-965d-82b4c6c33dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.759685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74acad0-6624-4a2d-965d-82b4c6c33dc5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.773385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c8826-f990-4811-b429-e180420b0b8f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.773591 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 318/621] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:54.780172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac41f-8d2d-4859-b579-28fa9bfb9125 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.780172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac41f-8d2d-4859-b579-28fa9bfb9125 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.780172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac41f-8d2d-4859-b579-28fa9bfb9125 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.781916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 319/622] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:54.782216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac41f-8d2d-4859-b579-28fa9bfb9125 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:54.812645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bcc18-6402-425d-a3eb-14827a4642cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:54.813283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bcc18-6402-425d-a3eb-14827a4642cb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.813559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bcc18-6402-425d-a3eb-14827a4642cb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.813824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bcc18-6402-425d-a3eb-14827a4642cb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.814409 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bcc18-6402-425d-a3eb-14827a4642cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.815804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bcc18-6402-425d-a3eb-14827a4642cb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.817490 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-404bcc18-6402-425d-a3eb-14827a4642cb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:54.827778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:54.828993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:11:54.829886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:54.833834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 304/623] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Oct 27 01:11:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:54.834767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bcc18-6402-425d-a3eb-14827a4642cb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:54.904234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac41f-8d2d-4859-b579-28fa9bfb9125 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.938142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bcc18-6402-425d-a3eb-14827a4642cb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:54.939507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7567be-19b4-4e40-8a9c-414c7143b6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:54.940195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7567be-19b4-4e40-8a9c-414c7143b6ec None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.940553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7567be-19b4-4e40-8a9c-414c7143b6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.940892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7567be-19b4-4e40-8a9c-414c7143b6ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.941644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7567be-19b4-4e40-8a9c-414c7143b6ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:54.943063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7567be-19b4-4e40-8a9c-414c7143b6ec None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:54.949056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:54.970769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 320/624] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:11:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:54.970769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040971d9-65fe-4d5b-9fd0-eaaec70c56fb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:54.970769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040971d9-65fe-4d5b-9fd0-eaaec70c56fb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:54.970769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040971d9-65fe-4d5b-9fd0-eaaec70c56fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:54.988865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-040971d9-65fe-4d5b-9fd0-eaaec70c56fb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:54.990114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-040971d9-65fe-4d5b-9fd0-eaaec70c56fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:55.016662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c074-9b2c-4b7b-923f-faaada18783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:55.017970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c074-9b2c-4b7b-923f-faaada18783d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:55.018484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c074-9b2c-4b7b-923f-faaada18783d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:55.019304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c074-9b2c-4b7b-923f-faaada18783d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:55.030999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920c074-9b2c-4b7b-923f-faaada18783d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:55.033408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920c074-9b2c-4b7b-923f-faaada18783d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f920c074-9b2c-4b7b-923f-faaada18783d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:55.051542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:55.052529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:55.053432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:55.053432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:55.053432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:55.053432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:55.053432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:55.053432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:55.053432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:55.053432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:55.056628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 305/625] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:55.057807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c074-9b2c-4b7b-923f-faaada18783d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:55.083303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 321/626] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:55.084880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040971d9-65fe-4d5b-9fd0-eaaec70c56fb None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:55.113442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:55.186090 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c074-9b2c-4b7b-923f-faaada18783d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:55.233950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53785c24-67af-4013-98ad-b5a7194e07fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:55.235270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53785c24-67af-4013-98ad-b5a7194e07fc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:55.235784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53785c24-67af-4013-98ad-b5a7194e07fc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:55.236335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53785c24-67af-4013-98ad-b5a7194e07fc None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:55.237447 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53785c24-67af-4013-98ad-b5a7194e07fc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:55.238822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53785c24-67af-4013-98ad-b5a7194e07fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:55.240533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53785c24-67af-4013-98ad-b5a7194e07fc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:55.247059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040971d9-65fe-4d5b-9fd0-eaaec70c56fb None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:55.247255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 306/627] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:11:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:55.254835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53785c24-67af-4013-98ad-b5a7194e07fc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:55.287327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:55.288386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e357755-85d8-4cdf-9f3f-436151c78ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:55.289217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e357755-85d8-4cdf-9f3f-436151c78ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:55.289610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e357755-85d8-4cdf-9f3f-436151c78ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:55.290026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e357755-85d8-4cdf-9f3f-436151c78ae4 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:55.291535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e357755-85d8-4cdf-9f3f-436151c78ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:55.291947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e357755-85d8-4cdf-9f3f-436151c78ae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:55.294263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e357755-85d8-4cdf-9f3f-436151c78ae4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:55.315141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 322/628] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:55.316194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e357755-85d8-4cdf-9f3f-436151c78ae4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:55.373885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53785c24-67af-4013-98ad-b5a7194e07fc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:55.412334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:55.451107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db1d7a-1b17-44c8-a14f-850a42ce9c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:55.451734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db1d7a-1b17-44c8-a14f-850a42ce9c61 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:55.452176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db1d7a-1b17-44c8-a14f-850a42ce9c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:55.452448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db1d7a-1b17-44c8-a14f-850a42ce9c61 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:55.453419 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db1d7a-1b17-44c8-a14f-850a42ce9c61 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:55.453991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db1d7a-1b17-44c8-a14f-850a42ce9c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:55.455864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db1d7a-1b17-44c8-a14f-850a42ce9c61 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:55.459420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e357755-85d8-4cdf-9f3f-436151c78ae4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:55.461508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 307/629] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:11:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:55.463345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db1d7a-1b17-44c8-a14f-850a42ce9c61 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:55.524636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f6bc1-eb42-4485-8033-60439d579c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:55.525393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f6bc1-eb42-4485-8033-60439d579c19 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:55.525879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f6bc1-eb42-4485-8033-60439d579c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:55.526391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f6bc1-eb42-4485-8033-60439d579c19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:55.527295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f6bc1-eb42-4485-8033-60439d579c19 None admin] RBAC: Adding query filter params (role.id=72129dcc28d546169fd012284e4019ec, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=b38639ab90e5439a990cf603c627dab3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:55.527706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f6bc1-eb42-4485-8033-60439d579c19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:55.529447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f6bc1-eb42-4485-8033-60439d579c19 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:55.549494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 323/630] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:11:55 2022] GET /identity/v3/role_assignments?user.id=b38639ab90e5439a990cf603c627dab3&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=72129dcc28d546169fd012284e4019ec => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:55.614360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db1d7a-1b17-44c8-a14f-850a42ce9c61 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:55.623165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:55.670381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c25bc0-2759-4e8e-aec8-a4942fafda85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:55.671076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c25bc0-2759-4e8e-aec8-a4942fafda85 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:55.671358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c25bc0-2759-4e8e-aec8-a4942fafda85 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:55.671634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c25bc0-2759-4e8e-aec8-a4942fafda85 None admin] PATH_INFO: `/v3/services/network` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:55.672252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c25bc0-2759-4e8e-aec8-a4942fafda85 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:55.673723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c25bc0-2759-4e8e-aec8-a4942fafda85 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-52c25bc0-2759-4e8e-aec8-a4942fafda85 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:55.686013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:55.687110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:55.687941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 308/631] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:55 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:55.695642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f6bc1-eb42-4485-8033-60439d579c19 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:55.880906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f6bc1-eb42-4485-8033-60439d579c19 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:55.914551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9637e-138d-4a94-9071-0d0b1db33343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:55.915346 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9637e-138d-4a94-9071-0d0b1db33343 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:55.915586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9637e-138d-4a94-9071-0d0b1db33343 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:55.915778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9637e-138d-4a94-9071-0d0b1db33343 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:55.916421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9637e-138d-4a94-9071-0d0b1db33343 None admin] RBAC: Adding query filter params (name=network) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:55.916710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9637e-138d-4a94-9071-0d0b1db33343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:55.918061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9637e-138d-4a94-9071-0d0b1db33343 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:55.923244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 324/632] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:11:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:55.927041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:55.931804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c25bc0-2759-4e8e-aec8-a4942fafda85 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:56.168809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c25bc0-2759-4e8e-aec8-a4942fafda85 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:56.241738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e3671-4084-4ed2-8fcc-464fe969644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:56.242365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e3671-4084-4ed2-8fcc-464fe969644c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:56.242643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e3671-4084-4ed2-8fcc-464fe969644c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:56.242967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e3671-4084-4ed2-8fcc-464fe969644c None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:56.247041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e3671-4084-4ed2-8fcc-464fe969644c None admin] RBAC: Adding query filter params (type=network) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:56.247359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e3671-4084-4ed2-8fcc-464fe969644c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:56.249091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e3671-4084-4ed2-8fcc-464fe969644c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:56.256649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 309/633] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:11:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:56.265635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9637e-138d-4a94-9071-0d0b1db33343 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:56.397398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9637e-138d-4a94-9071-0d0b1db33343 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:56.447522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f0118-4539-4f79-95f1-25e9469dbd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:56.448068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f0118-4539-4f79-95f1-25e9469dbd3b None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:56.448351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f0118-4539-4f79-95f1-25e9469dbd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:56.448612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f0118-4539-4f79-95f1-25e9469dbd3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:56.449285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f0118-4539-4f79-95f1-25e9469dbd3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:56.450653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f0118-4539-4f79-95f1-25e9469dbd3b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:56.471620 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 325/634] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:11:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:57.142779 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8508-09b3-467a-9e60-7ec4a29bcddf None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:57.143142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8508-09b3-467a-9e60-7ec4a29bcddf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:57.143254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8508-09b3-467a-9e60-7ec4a29bcddf None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:57.144941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 310/635] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:57.150341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a673-a5ac-4745-bcd8-86232f17d14a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:57.151214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a673-a5ac-4745-bcd8-86232f17d14a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:57.151679 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a673-a5ac-4745-bcd8-86232f17d14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:57.170546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5ee7a673-a5ac-4745-bcd8-86232f17d14a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:57.172127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5ee7a673-a5ac-4745-bcd8-86232f17d14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:57.222932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:57.246878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 326/636] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:57.508097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8508-09b3-467a-9e60-7ec4a29bcddf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:57.530951 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:57.611616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8508-09b3-467a-9e60-7ec4a29bcddf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:57.645944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe10fcf-f06d-4d90-871c-2cec7b1e7c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:57.646584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe10fcf-f06d-4d90-871c-2cec7b1e7c1e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:57.646886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe10fcf-f06d-4d90-871c-2cec7b1e7c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:57.647155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe10fcf-f06d-4d90-871c-2cec7b1e7c1e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:57.659383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe10fcf-f06d-4d90-871c-2cec7b1e7c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9fe10fcf-f06d-4d90-871c-2cec7b1e7c1e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:11:57.664548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:57.665680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:11:57.666529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:57.670944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 311/637] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Oct 27 01:11:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:57.672675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a673-a5ac-4745-bcd8-86232f17d14a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:57.775982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a673-a5ac-4745-bcd8-86232f17d14a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:57.787831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca70d-6fac-4770-ad84-9c370e7849cb None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:57.788112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca70d-6fac-4770-ad84-9c370e7849cb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:57.788394 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca70d-6fac-4770-ad84-9c370e7849cb None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:57.790115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 312/638] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:57.795265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9de2-3af7-4dfd-9688-f5cc337bb034 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:57.795548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9de2-3af7-4dfd-9688-f5cc337bb034 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:57.795822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c9de2-3af7-4dfd-9688-f5cc337bb034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:57.811295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f2995-8b2a-4d55-aeae-d8c9a6e229c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:57.811908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f2995-8b2a-4d55-aeae-d8c9a6e229c5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:57.812237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f2995-8b2a-4d55-aeae-d8c9a6e229c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:57.812511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f2995-8b2a-4d55-aeae-d8c9a6e229c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:57.813311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f2995-8b2a-4d55-aeae-d8c9a6e229c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:57.813613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f2995-8b2a-4d55-aeae-d8c9a6e229c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:57.814112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c94c9de2-3af7-4dfd-9688-f5cc337bb034 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:57.815049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f2995-8b2a-4d55-aeae-d8c9a6e229c5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:57.815333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c94c9de2-3af7-4dfd-9688-f5cc337bb034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:57.827826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 327/639] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Oct 27 01:11:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:57.829082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f2995-8b2a-4d55-aeae-d8c9a6e229c5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:57.883614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:57.916808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 313/640] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:11:57.945880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f2995-8b2a-4d55-aeae-d8c9a6e229c5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:57.982987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b41191-b74a-4e00-9d0d-5c1f8b3aa505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:57.983995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b41191-b74a-4e00-9d0d-5c1f8b3aa505 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:57.984421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b41191-b74a-4e00-9d0d-5c1f8b3aa505 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:57.984888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b41191-b74a-4e00-9d0d-5c1f8b3aa505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:57.998536 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b41191-b74a-4e00-9d0d-5c1f8b3aa505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.000332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b41191-b74a-4e00-9d0d-5c1f8b3aa505 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-37b41191-b74a-4e00-9d0d-5c1f8b3aa505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:58.017517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:58.018792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:58.019908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:58.019908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:58.019908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:58.021829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 328/641] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:58.027903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9de2-3af7-4dfd-9688-f5cc337bb034 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.040778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:58.119500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d78b-c779-4866-8c9b-a472e236d4ec None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.120151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d78b-c779-4866-8c9b-a472e236d4ec None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.120838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d78b-c779-4866-8c9b-a472e236d4ec None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.122345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 329/642] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:11:58.123246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c80392-678f-42f2-9223-746c7f40f53f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.123529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c80392-678f-42f2-9223-746c7f40f53f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.123804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c80392-678f-42f2-9223-746c7f40f53f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.125262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 330/643] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:11:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:58.130454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3638-c2ab-4065-9221-2db02d585982 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.130810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3638-c2ab-4065-9221-2db02d585982 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.131039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3638-c2ab-4065-9221-2db02d585982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.137289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c9de2-3af7-4dfd-9688-f5cc337bb034 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:58.150287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-70ef3638-c2ab-4065-9221-2db02d585982 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:58.151526 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-70ef3638-c2ab-4065-9221-2db02d585982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:58.172956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2476a4a-eddd-4cc4-9efb-44d3b4ce92a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:58.173539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2476a4a-eddd-4cc4-9efb-44d3b4ce92a8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.173819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2476a4a-eddd-4cc4-9efb-44d3b4ce92a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.174169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2476a4a-eddd-4cc4-9efb-44d3b4ce92a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.174830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2476a4a-eddd-4cc4-9efb-44d3b4ce92a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:58.175164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2476a4a-eddd-4cc4-9efb-44d3b4ce92a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.176542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2476a4a-eddd-4cc4-9efb-44d3b4ce92a8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:58.188530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 314/644] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:58.192114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d60342-ee25-4479-8210-39e0a7e2fcd9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.192405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d60342-ee25-4479-8210-39e0a7e2fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.192683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d60342-ee25-4479-8210-39e0a7e2fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.210517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a7d60342-ee25-4479-8210-39e0a7e2fcd9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:58.211744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a7d60342-ee25-4479-8210-39e0a7e2fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:58.220347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 331/645] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:58.222096 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3638-c2ab-4065-9221-2db02d585982 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.248587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:58.282094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:58.298998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 315/646] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:11:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:11:58.299760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d60342-ee25-4479-8210-39e0a7e2fcd9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.334306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3638-c2ab-4065-9221-2db02d585982 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:58.373422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341ee17-0e89-4417-8d7f-0810fa1bc14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:58.374281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ee17-0e89-4417-8d7f-0810fa1bc14e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.374942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ee17-0e89-4417-8d7f-0810fa1bc14e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.374942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ee17-0e89-4417-8d7f-0810fa1bc14e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.375407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341ee17-0e89-4417-8d7f-0810fa1bc14e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.376810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341ee17-0e89-4417-8d7f-0810fa1bc14e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-2341ee17-0e89-4417-8d7f-0810fa1bc14e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:58.386070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:58.387108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:58.391538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 332/647] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:11:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:58.394079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341ee17-0e89-4417-8d7f-0810fa1bc14e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.429604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d60342-ee25-4479-8210-39e0a7e2fcd9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:58.469592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6cc66-6627-478a-9e67-6a01b57e7f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:58.470582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6cc66-6627-478a-9e67-6a01b57e7f7c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.471106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6cc66-6627-478a-9e67-6a01b57e7f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.471553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6cc66-6627-478a-9e67-6a01b57e7f7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.479895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6cc66-6627-478a-9e67-6a01b57e7f7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.482163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6cc66-6627-478a-9e67-6a01b57e7f7c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:58.488845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-98d6cc66-6627-478a-9e67-6a01b57e7f7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:11:58.496144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:58.497102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 316/648] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Oct 27 01:11:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:58.498094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6cc66-6627-478a-9e67-6a01b57e7f7c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.504770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341ee17-0e89-4417-8d7f-0810fa1bc14e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:58.541371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106792-2216-4c93-90f9-95c02af2ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:58.542325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106792-2216-4c93-90f9-95c02af2ec80 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.542844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106792-2216-4c93-90f9-95c02af2ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.543189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106792-2216-4c93-90f9-95c02af2ec80 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.543898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0106792-2216-4c93-90f9-95c02af2ec80 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:58.544408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0106792-2216-4c93-90f9-95c02af2ec80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.545638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0106792-2216-4c93-90f9-95c02af2ec80 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:58.550183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 333/649] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:11:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:58.550183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106792-2216-4c93-90f9-95c02af2ec80 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.564708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:58.604998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6cc66-6627-478a-9e67-6a01b57e7f7c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:58.637166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717f8ce-09a7-4195-b4c2-bdc342a44838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:58.638154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717f8ce-09a7-4195-b4c2-bdc342a44838 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.638430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717f8ce-09a7-4195-b4c2-bdc342a44838 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.638696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717f8ce-09a7-4195-b4c2-bdc342a44838 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.639304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717f8ce-09a7-4195-b4c2-bdc342a44838 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.640670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717f8ce-09a7-4195-b4c2-bdc342a44838 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1717f8ce-09a7-4195-b4c2-bdc342a44838 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:58.649750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:58.650990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:11:58.651828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:58.652585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106792-2216-4c93-90f9-95c02af2ec80 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:58.652668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 317/650] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:11:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:58.652668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717f8ce-09a7-4195-b4c2-bdc342a44838 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.684918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47806e4-b0de-445e-9787-23510c6348ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:58.685529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47806e4-b0de-445e-9787-23510c6348ee None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.685807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47806e4-b0de-445e-9787-23510c6348ee None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.686069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47806e4-b0de-445e-9787-23510c6348ee None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.686814 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47806e4-b0de-445e-9787-23510c6348ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:58.687118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47806e4-b0de-445e-9787-23510c6348ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.688549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47806e4-b0de-445e-9787-23510c6348ee None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:58.705488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 334/651] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Oct 27 01:11:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:58.706380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47806e4-b0de-445e-9787-23510c6348ee None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.720283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:58.753533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717f8ce-09a7-4195-b4c2-bdc342a44838 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:58.776524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:58.787323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69b6d7-fd16-43eb-9747-ada5123d0e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:58.787933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69b6d7-fd16-43eb-9747-ada5123d0e87 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.788205 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69b6d7-fd16-43eb-9747-ada5123d0e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.788474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69b6d7-fd16-43eb-9747-ada5123d0e87 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.789121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69b6d7-fd16-43eb-9747-ada5123d0e87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.790696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69b6d7-fd16-43eb-9747-ada5123d0e87 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:58.805623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47806e4-b0de-445e-9787-23510c6348ee None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:58.806215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 318/652] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:11:58 2022] POST /identity/v3/services => generated 269 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:11:58.807052 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69b6d7-fd16-43eb-9747-ada5123d0e87 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.859273 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c48607-95c6-473b-a883-663b1430fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:58.859896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c48607-95c6-473b-a883-663b1430fd8c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.860222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c48607-95c6-473b-a883-663b1430fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.860497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c48607-95c6-473b-a883-663b1430fd8c None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.861183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c48607-95c6-473b-a883-663b1430fd8c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:58.861573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c48607-95c6-473b-a883-663b1430fd8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.863024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c48607-95c6-473b-a883-663b1430fd8c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:58.873822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 335/653] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:11:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:58.873822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c48607-95c6-473b-a883-663b1430fd8c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:58.945355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69b6d7-fd16-43eb-9747-ada5123d0e87 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:58.986175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:58.994180 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9995eaa-04f5-467b-a70f-900d64ca39ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:58.994884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995eaa-04f5-467b-a70f-900d64ca39ab None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:58.995165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995eaa-04f5-467b-a70f-900d64ca39ab None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:58.995433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995eaa-04f5-467b-a70f-900d64ca39ab None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:58.996098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9995eaa-04f5-467b-a70f-900d64ca39ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:58.996392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9995eaa-04f5-467b-a70f-900d64ca39ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:58.997818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9995eaa-04f5-467b-a70f-900d64ca39ab None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:59.008101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 319/654] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:11:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:59.009628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9995eaa-04f5-467b-a70f-900d64ca39ab None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:59.029844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c48607-95c6-473b-a883-663b1430fd8c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:59.070700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:59.073957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814724-9b97-4345-8b2b-626810d6923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:59.074911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814724-9b97-4345-8b2b-626810d6923a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.075387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814724-9b97-4345-8b2b-626810d6923a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.075833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814724-9b97-4345-8b2b-626810d6923a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.089966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814724-9b97-4345-8b2b-626810d6923a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:59.091856 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814724-9b97-4345-8b2b-626810d6923a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-51814724-9b97-4345-8b2b-626810d6923a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:11:59.110406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:59.111428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:11:59.113869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:11:59.113869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:11:59.113869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:11:59.113869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 336/655] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:59.119757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814724-9b97-4345-8b2b-626810d6923a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:59.132558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9995eaa-04f5-467b-a70f-900d64ca39ab None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:59.179725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4c35b-784b-46dc-bcde-a11ea1dd92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:59.180382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4c35b-784b-46dc-bcde-a11ea1dd92df None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.180666 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4c35b-784b-46dc-bcde-a11ea1dd92df None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.181199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4c35b-784b-46dc-bcde-a11ea1dd92df None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.182449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4c35b-784b-46dc-bcde-a11ea1dd92df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:59.182819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4c35b-784b-46dc-bcde-a11ea1dd92df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:59.184744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4c35b-784b-46dc-bcde-a11ea1dd92df None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:59.192084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 320/656] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:11:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:59.250301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814724-9b97-4345-8b2b-626810d6923a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:59.278442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:59.291813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ac8c4-f35f-48b9-98b0-cfac568dd15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:59.292646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ac8c4-f35f-48b9-98b0-cfac568dd15f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.292935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ac8c4-f35f-48b9-98b0-cfac568dd15f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.293213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ac8c4-f35f-48b9-98b0-cfac568dd15f None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.293884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ac8c4-f35f-48b9-98b0-cfac568dd15f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:59.294191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ac8c4-f35f-48b9-98b0-cfac568dd15f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:59.295715 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ac8c4-f35f-48b9-98b0-cfac568dd15f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:59.312812 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 337/657] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:11:59.318870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4c35b-784b-46dc-bcde-a11ea1dd92df None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:59.428740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4c35b-784b-46dc-bcde-a11ea1dd92df None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:59.442017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:11:59.467014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3324c-b2b1-4aab-bf99-c672a8d73a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:59.467658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3324c-b2b1-4aab-bf99-c672a8d73a6f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.467939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3324c-b2b1-4aab-bf99-c672a8d73a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.468220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3324c-b2b1-4aab-bf99-c672a8d73a6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.475275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3324c-b2b1-4aab-bf99-c672a8d73a6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:59.476975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3324c-b2b1-4aab-bf99-c672a8d73a6f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3fd3324c-b2b1-4aab-bf99-c672a8d73a6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:11:59.489050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:11:59.489960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:11:59.491501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:11:59.491501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:11:59.491501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:11:59.491501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:11:59.491501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:11:59.491501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:11:59.491501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:11:59.491501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:11:59.491501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 321/658] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:11:59.498270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ac8c4-f35f-48b9-98b0-cfac568dd15f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:59.604290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ac8c4-f35f-48b9-98b0-cfac568dd15f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:59.642189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3832-68eb-4431-b884-0019b1b51fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:59.642841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3832-68eb-4431-b884-0019b1b51fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.643128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3832-68eb-4431-b884-0019b1b51fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.643403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3832-68eb-4431-b884-0019b1b51fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.644106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3832-68eb-4431-b884-0019b1b51fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:11:59.644413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3832-68eb-4431-b884-0019b1b51fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:59.645857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3832-68eb-4431-b884-0019b1b51fc2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:59.658680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 338/659] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:59.664396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3324c-b2b1-4aab-bf99-c672a8d73a6f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:59.776345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3324c-b2b1-4aab-bf99-c672a8d73a6f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:59.818237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2936-ea3c-4fdb-8d2e-ab5c5e2d4aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:59.819341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2936-ea3c-4fdb-8d2e-ab5c5e2d4aaf None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.819844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2936-ea3c-4fdb-8d2e-ab5c5e2d4aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.820341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2936-ea3c-4fdb-8d2e-ab5c5e2d4aaf None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/22b2d94a0f0c442688ef74359536281e/roles/2543068f563f4327a495ba5e5d4a430a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.822802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e2936-ea3c-4fdb-8d2e-ab5c5e2d4aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=22b2d94a0f0c442688ef74359536281e, role_id=2543068f563f4327a495ba5e5d4a430a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:59.824493 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e2936-ea3c-4fdb-8d2e-ab5c5e2d4aaf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:59.845517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 322/660] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:11:59 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/22b2d94a0f0c442688ef74359536281e/roles/2543068f563f4327a495ba5e5d4a430a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:12:01.075324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde7a8-d784-47f1-b1bd-e8f810f23149 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.076343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde7a8-d784-47f1-b1bd-e8f810f23149 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.076819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dde7a8-d784-47f1-b1bd-e8f810f23149 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.078747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 339/661] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:01.083956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592afe3-7e8d-446f-b7fe-6ec3eb4fbe56 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.084385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592afe3-7e8d-446f-b7fe-6ec3eb4fbe56 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.084568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592afe3-7e8d-446f-b7fe-6ec3eb4fbe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.103834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f592afe3-7e8d-446f-b7fe-6ec3eb4fbe56 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:01.104962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f592afe3-7e8d-446f-b7fe-6ec3eb4fbe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:01.120698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e5c3-e80e-4ce3-a071-b1d383068a48 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.120987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e5c3-e80e-4ce3-a071-b1d383068a48 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.121269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e5c3-e80e-4ce3-a071-b1d383068a48 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.122877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 340/662] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:01.128121 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28aa27-a356-4138-97a3-bd1a26c37b3f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.128409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28aa27-a356-4138-97a3-bd1a26c37b3f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.128687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28aa27-a356-4138-97a3-bd1a26c37b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.135039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:01.149129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ee28aa27-a356-4138-97a3-bd1a26c37b3f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:01.150353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ee28aa27-a356-4138-97a3-bd1a26c37b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:01.191963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 323/663] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:01.207068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:01.226683 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 341/664] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:01.457496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592afe3-7e8d-446f-b7fe-6ec3eb4fbe56 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:01.491662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28aa27-a356-4138-97a3-bd1a26c37b3f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:01.566058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592afe3-7e8d-446f-b7fe-6ec3eb4fbe56 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:01.600548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28aa27-a356-4138-97a3-bd1a26c37b3f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:01.602473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f623d59-10fe-40aa-9485-5f5f0a572735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:01.603155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623d59-10fe-40aa-9485-5f5f0a572735 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.603439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623d59-10fe-40aa-9485-5f5f0a572735 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.603707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f623d59-10fe-40aa-9485-5f5f0a572735 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.604301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f623d59-10fe-40aa-9485-5f5f0a572735 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:01.605676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f623d59-10fe-40aa-9485-5f5f0a572735 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3f623d59-10fe-40aa-9485-5f5f0a572735 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:01.614524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:01.615609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:01.616580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 324/665] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Oct 27 01:12:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:01.617365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55005a1-61f7-48ea-adaf-6eea96f4e904 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.617365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55005a1-61f7-48ea-adaf-6eea96f4e904 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.617365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55005a1-61f7-48ea-adaf-6eea96f4e904 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.618906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 325/666] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:01.621300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55005a1-61f7-48ea-adaf-6eea96f4e904 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:01.646110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cbb20-cbb1-4a97-b45b-b25cc3d7332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:01.647011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cbb20-cbb1-4a97-b45b-b25cc3d7332f None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.647443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cbb20-cbb1-4a97-b45b-b25cc3d7332f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.647716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cbb20-cbb1-4a97-b45b-b25cc3d7332f None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.648383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cbb20-cbb1-4a97-b45b-b25cc3d7332f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:01.649794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cbb20-cbb1-4a97-b45b-b25cc3d7332f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:01.650999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:01.665856 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 342/667] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:12:01 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:12:01.676223 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc03d6-f4b7-4cb6-899d-a88254b2c0ea None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.676621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc03d6-f4b7-4cb6-899d-a88254b2c0ea None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.676904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc03d6-f4b7-4cb6-899d-a88254b2c0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.702290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3bcc03d6-f4b7-4cb6-899d-a88254b2c0ea None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:01.703865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3bcc03d6-f4b7-4cb6-899d-a88254b2c0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:01.737229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:01.748748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55005a1-61f7-48ea-adaf-6eea96f4e904 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:01.789975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971b87-1fcc-4581-85d5-ce7f14c1e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:01.791062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971b87-1fcc-4581-85d5-ce7f14c1e503 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.791559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971b87-1fcc-4581-85d5-ce7f14c1e503 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.792046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971b87-1fcc-4581-85d5-ce7f14c1e503 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.793427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11971b87-1fcc-4581-85d5-ce7f14c1e503 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:01.794152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11971b87-1fcc-4581-85d5-ce7f14c1e503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:01.796026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 343/668] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:01.796621 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11971b87-1fcc-4581-85d5-ce7f14c1e503 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:01.802587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 326/669] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:12:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:01.814755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc03d6-f4b7-4cb6-899d-a88254b2c0ea None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:01.926632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc03d6-f4b7-4cb6-899d-a88254b2c0ea None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:01.962377 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc562e1-af2e-4be1-80f3-1d0165343bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:01.963042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc562e1-af2e-4be1-80f3-1d0165343bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.963413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc562e1-af2e-4be1-80f3-1d0165343bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.963701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc562e1-af2e-4be1-80f3-1d0165343bc7 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.964400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc562e1-af2e-4be1-80f3-1d0165343bc7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:01.964716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc562e1-af2e-4be1-80f3-1d0165343bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:01.966133 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc562e1-af2e-4be1-80f3-1d0165343bc7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:01.971945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 344/670] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:12:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:01.977944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971b87-1fcc-4581-85d5-ce7f14c1e503 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:02.015177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d9f76-8a6d-4849-b448-62263cb5e30b None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:02.015354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d9f76-8a6d-4849-b448-62263cb5e30b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:02.015636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d9f76-8a6d-4849-b448-62263cb5e30b None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:02.016982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 345/671] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:02.022430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf066def-d229-45d9-8153-6cf06549393f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:02.022734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf066def-d229-45d9-8153-6cf06549393f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:02.023016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf066def-d229-45d9-8153-6cf06549393f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:02.044406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cf066def-d229-45d9-8153-6cf06549393f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:02.046259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cf066def-d229-45d9-8153-6cf06549393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:02.070515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:02.071227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:02.087675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971b87-1fcc-4581-85d5-ce7f14c1e503 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:02.122664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3009a1a-fe5a-4f54-959e-c790e3886e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:02.123309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3009a1a-fe5a-4f54-959e-c790e3886e12 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:02.123662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 346/672] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:02.124560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf066def-d229-45d9-8153-6cf06549393f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:02.127061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3009a1a-fe5a-4f54-959e-c790e3886e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:02.127350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3009a1a-fe5a-4f54-959e-c790e3886e12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:02.128088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3009a1a-fe5a-4f54-959e-c790e3886e12 None admin] RBAC: Adding query filter params (interface=public, service_id=16f1596ae07e4c44aef7db293ea9b2d8, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:02.128396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3009a1a-fe5a-4f54-959e-c790e3886e12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:02.130545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3009a1a-fe5a-4f54-959e-c790e3886e12 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:02.140949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 327/673] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Oct 27 01:12:01 2022] GET /identity/v3/endpoints?service_id=16f1596ae07e4c44aef7db293ea9b2d8&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:02.146757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3009a1a-fe5a-4f54-959e-c790e3886e12 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:02.245625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf066def-d229-45d9-8153-6cf06549393f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:02.281579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3009a1a-fe5a-4f54-959e-c790e3886e12 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:02.281768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30d527-a86c-4d89-9019-5618389d2228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:02.282416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d527-a86c-4d89-9019-5618389d2228 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:02.282696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d527-a86c-4d89-9019-5618389d2228 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:02.283003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d527-a86c-4d89-9019-5618389d2228 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:02.283729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30d527-a86c-4d89-9019-5618389d2228 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:02.285597 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30d527-a86c-4d89-9019-5618389d2228 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:02.305305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 347/674] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:12:02 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:02.333239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a4c63-d177-48f7-a1ef-d06b2d492781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:02.333942 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4c63-d177-48f7-a1ef-d06b2d492781 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:02.334277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4c63-d177-48f7-a1ef-d06b2d492781 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:02.334557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4c63-d177-48f7-a1ef-d06b2d492781 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:02.335322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a4c63-d177-48f7-a1ef-d06b2d492781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:02.337000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a4c63-d177-48f7-a1ef-d06b2d492781 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:02.344820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 328/675] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Oct 27 01:12:02 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:12:02.412989 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30d527-a86c-4d89-9019-5618389d2228 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:02.439262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:02.538292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30d527-a86c-4d89-9019-5618389d2228 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:02.574593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da978a-df00-4d92-8cba-50f39bedba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:02.575257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da978a-df00-4d92-8cba-50f39bedba93 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:02.575537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da978a-df00-4d92-8cba-50f39bedba93 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:02.575797 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da978a-df00-4d92-8cba-50f39bedba93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:02.587797 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da978a-df00-4d92-8cba-50f39bedba93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-37da978a-df00-4d92-8cba-50f39bedba93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:12:02.593308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:02.594206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:02.595535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 348/676] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Oct 27 01:12:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:02.600730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a4c63-d177-48f7-a1ef-d06b2d492781 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:02.614261 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:02.708996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a4c63-d177-48f7-a1ef-d06b2d492781 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:02.743408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d603663-1400-48bc-b829-35050e880630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:02.744020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d603663-1400-48bc-b829-35050e880630 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:02.744298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d603663-1400-48bc-b829-35050e880630 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:02.744606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d603663-1400-48bc-b829-35050e880630 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:02.745277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d603663-1400-48bc-b829-35050e880630 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:02.745575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d603663-1400-48bc-b829-35050e880630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:02.746953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d603663-1400-48bc-b829-35050e880630 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:02.755577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 329/677] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Oct 27 01:12:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:02.761598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da978a-df00-4d92-8cba-50f39bedba93 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:02.859073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:02.871117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da978a-df00-4d92-8cba-50f39bedba93 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:02.906453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06957cc1-c62d-4b07-b392-dbbd0b277ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:02.907128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06957cc1-c62d-4b07-b392-dbbd0b277ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:02.907406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06957cc1-c62d-4b07-b392-dbbd0b277ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:02.907673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06957cc1-c62d-4b07-b392-dbbd0b277ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:02.918068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06957cc1-c62d-4b07-b392-dbbd0b277ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:02.919551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06957cc1-c62d-4b07-b392-dbbd0b277ea8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-06957cc1-c62d-4b07-b392-dbbd0b277ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:12:02.934337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:02.935359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:12:02.936359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:12:02.936359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:02.936359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:02.936359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 349/678] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:02.944167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d603663-1400-48bc-b829-35050e880630 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:03.021214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:03.053727 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d603663-1400-48bc-b829-35050e880630 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:03.089067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd097c-7500-43cd-b99b-7a5921bbd7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:03.089698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd097c-7500-43cd-b99b-7a5921bbd7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:03.089946 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd097c-7500-43cd-b99b-7a5921bbd7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:03.090216 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd097c-7500-43cd-b99b-7a5921bbd7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:03.090897 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd097c-7500-43cd-b99b-7a5921bbd7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:03.091198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd097c-7500-43cd-b99b-7a5921bbd7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:03.092552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd097c-7500-43cd-b99b-7a5921bbd7e2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:03.105169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 330/679] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:03.110749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06957cc1-c62d-4b07-b392-dbbd0b277ea8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:03.210260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06957cc1-c62d-4b07-b392-dbbd0b277ea8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:03.239588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:03.247793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a23147-cd6f-4e83-b815-7805e5081fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:03.248889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23147-cd6f-4e83-b815-7805e5081fcd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:03.249425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23147-cd6f-4e83-b815-7805e5081fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:03.249895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23147-cd6f-4e83-b815-7805e5081fcd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:03.259018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a23147-cd6f-4e83-b815-7805e5081fcd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:03.260836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a23147-cd6f-4e83-b815-7805e5081fcd None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-19a23147-cd6f-4e83-b815-7805e5081fcd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:12:03.273217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:03.274231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:12:03.275181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:03.277693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 350/680] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Oct 27 01:12:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:03.283670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd097c-7500-43cd-b99b-7a5921bbd7e2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:03.388625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd097c-7500-43cd-b99b-7a5921bbd7e2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:03.418297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:03.423293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7f8d5-a333-4b72-92ae-8221db65de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:03.423937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7f8d5-a333-4b72-92ae-8221db65de61 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:03.424214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7f8d5-a333-4b72-92ae-8221db65de61 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:03.424489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7f8d5-a333-4b72-92ae-8221db65de61 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:03.425226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7f8d5-a333-4b72-92ae-8221db65de61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:03.425899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7f8d5-a333-4b72-92ae-8221db65de61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:03.427600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7f8d5-a333-4b72-92ae-8221db65de61 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:03.450510 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 331/681] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Oct 27 01:12:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:03.456272 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a23147-cd6f-4e83-b815-7805e5081fcd None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:03.557862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a23147-cd6f-4e83-b815-7805e5081fcd None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:03.591680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11103bd0-280c-4731-80ee-bb49a86304d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:03.592394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11103bd0-280c-4731-80ee-bb49a86304d1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:03.592665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11103bd0-280c-4731-80ee-bb49a86304d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:03.592943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11103bd0-280c-4731-80ee-bb49a86304d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:03.650011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:03.660719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11103bd0-280c-4731-80ee-bb49a86304d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:03.662428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11103bd0-280c-4731-80ee-bb49a86304d1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:03.760083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 351/682] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:12:03 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:03.765770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7f8d5-a333-4b72-92ae-8221db65de61 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:03.883103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7f8d5-a333-4b72-92ae-8221db65de61 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:03.918299 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a56dc-e30e-4020-9825-8a44a2939f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:03.918880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a56dc-e30e-4020-9825-8a44a2939f31 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:03.919159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a56dc-e30e-4020-9825-8a44a2939f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:03.919433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a56dc-e30e-4020-9825-8a44a2939f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:03.930260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a56dc-e30e-4020-9825-8a44a2939f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:03.931735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a56dc-e30e-4020-9825-8a44a2939f31 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-725a56dc-e30e-4020-9825-8a44a2939f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:12:03.946676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:03.947658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:12:03.948950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:12:03.948950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:03.948950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:03.948950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 332/683] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:03.950134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862368e2-4a91-48a9-9304-6036c7baca2f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:03.950421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862368e2-4a91-48a9-9304-6036c7baca2f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:03.950697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862368e2-4a91-48a9-9304-6036c7baca2f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:03.952363 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 352/684] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:03.953459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a56dc-e30e-4020-9825-8a44a2939f31 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:03.957386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31eef-745d-4b1d-834d-2b340187ca12 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:03.957664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31eef-745d-4b1d-834d-2b340187ca12 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:03.957935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31eef-745d-4b1d-834d-2b340187ca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:03.976727 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5ee31eef-745d-4b1d-834d-2b340187ca12 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:03.978010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5ee31eef-745d-4b1d-834d-2b340187ca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:04.000890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:04.058619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 353/685] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:04.070920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a56dc-e30e-4020-9825-8a44a2939f31 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:04.106811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea6663-bc8e-48a3-873b-0ea439714ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:04.107604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6663-bc8e-48a3-873b-0ea439714ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.107757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6663-bc8e-48a3-873b-0ea439714ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.107943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6663-bc8e-48a3-873b-0ea439714ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.108595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea6663-bc8e-48a3-873b-0ea439714ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:04.108887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea6663-bc8e-48a3-873b-0ea439714ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:04.110259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea6663-bc8e-48a3-873b-0ea439714ad0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:04.122767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 333/686] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:04.131870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31eef-745d-4b1d-834d-2b340187ca12 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:04.156493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:04.234159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31eef-745d-4b1d-834d-2b340187ca12 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:04.268332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254d1e-d2ae-4817-a8e1-527791391b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:04.268973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254d1e-d2ae-4817-a8e1-527791391b7a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.269254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254d1e-d2ae-4817-a8e1-527791391b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.269525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254d1e-d2ae-4817-a8e1-527791391b7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.276273 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254d1e-d2ae-4817-a8e1-527791391b7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:04.277707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254d1e-d2ae-4817-a8e1-527791391b7a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-87254d1e-d2ae-4817-a8e1-527791391b7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:12:04.289026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:04.291251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:04.293401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:12:04.293401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:12:04.293401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:12:04.293401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:12:04.293401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:12:04.293401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:12:04.293401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:12:04.293401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:04.293401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 354/687] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:04.299823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea6663-bc8e-48a3-873b-0ea439714ad0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:04.361980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254d1e-d2ae-4817-a8e1-527791391b7a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:04.427471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea6663-bc8e-48a3-873b-0ea439714ad0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:04.429590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:04.467215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:04.479197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58932a99-224e-4351-bf65-a89057b8b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:04.479707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58932a99-224e-4351-bf65-a89057b8b5cf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.480084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58932a99-224e-4351-bf65-a89057b8b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.480648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58932a99-224e-4351-bf65-a89057b8b5cf None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.481470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58932a99-224e-4351-bf65-a89057b8b5cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:04.481908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58932a99-224e-4351-bf65-a89057b8b5cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:04.483641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58932a99-224e-4351-bf65-a89057b8b5cf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:04.495303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254d1e-d2ae-4817-a8e1-527791391b7a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:04.498739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 334/688] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:04.503662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58932a99-224e-4351-bf65-a89057b8b5cf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:04.533073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb30eb-f045-4035-b263-438a28b3d2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:04.534015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb30eb-f045-4035-b263-438a28b3d2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.534438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb30eb-f045-4035-b263-438a28b3d2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.534983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb30eb-f045-4035-b263-438a28b3d2d3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.535820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb30eb-f045-4035-b263-438a28b3d2d3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:04.537422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb30eb-f045-4035-b263-438a28b3d2d3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-37fb30eb-f045-4035-b263-438a28b3d2d3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:04.547137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:04.548321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:12:04.549216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:04.552081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 355/689] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:12:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:12:04.558126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb30eb-f045-4035-b263-438a28b3d2d3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:04.613501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58932a99-224e-4351-bf65-a89057b8b5cf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:04.650253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959505e8-8256-4645-aeb8-28dcdb9335df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:04.651245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959505e8-8256-4645-aeb8-28dcdb9335df None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.651527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959505e8-8256-4645-aeb8-28dcdb9335df None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.651802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959505e8-8256-4645-aeb8-28dcdb9335df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.652539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959505e8-8256-4645-aeb8-28dcdb9335df None admin] RBAC: Adding query filter params (role.id=2543068f563f4327a495ba5e5d4a430a, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=22b2d94a0f0c442688ef74359536281e) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:04.652849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959505e8-8256-4645-aeb8-28dcdb9335df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:04.654271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959505e8-8256-4645-aeb8-28dcdb9335df None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:04.660733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 335/690] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:12:04 2022] GET /identity/v3/role_assignments?user.id=22b2d94a0f0c442688ef74359536281e&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=2543068f563f4327a495ba5e5d4a430a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:04.662055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce095f5-c8a9-46f4-9971-b5ea18a6aae2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.662351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce095f5-c8a9-46f4-9971-b5ea18a6aae2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.662628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce095f5-c8a9-46f4-9971-b5ea18a6aae2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.664257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 336/691] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:04.670688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5321a-e2ba-48ab-b1aa-31129b6fa97a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.671073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5321a-e2ba-48ab-b1aa-31129b6fa97a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.671287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5321a-e2ba-48ab-b1aa-31129b6fa97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.675456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb30eb-f045-4035-b263-438a28b3d2d3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:04.692481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fdd5321a-e2ba-48ab-b1aa-31129b6fa97a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:04.693765 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fdd5321a-e2ba-48ab-b1aa-31129b6fa97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:04.717837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:04.724867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89e8e-44d0-4ff9-a48a-b2eb2a005de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:04.726051 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89e8e-44d0-4ff9-a48a-b2eb2a005de7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.727047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89e8e-44d0-4ff9-a48a-b2eb2a005de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.727532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89e8e-44d0-4ff9-a48a-b2eb2a005de7 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.728723 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec89e8e-44d0-4ff9-a48a-b2eb2a005de7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:04.729232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec89e8e-44d0-4ff9-a48a-b2eb2a005de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:04.730915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec89e8e-44d0-4ff9-a48a-b2eb2a005de7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:04.743707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 356/692] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:12:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:04.745050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89e8e-44d0-4ff9-a48a-b2eb2a005de7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:04.758935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:04.783157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 337/693] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:04.793641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eafb4-b669-41fe-8bee-dc09cf187aea None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.793926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eafb4-b669-41fe-8bee-dc09cf187aea None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.794202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eafb4-b669-41fe-8bee-dc09cf187aea None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.800171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 338/694] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:04.801581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe787d-ae82-4017-a81e-86a35a57146d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.801870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe787d-ae82-4017-a81e-86a35a57146d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.802149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe787d-ae82-4017-a81e-86a35a57146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.821094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-16fe787d-ae82-4017-a81e-86a35a57146d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:04.822334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-16fe787d-ae82-4017-a81e-86a35a57146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:04.869760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89e8e-44d0-4ff9-a48a-b2eb2a005de7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:04.911642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 339/695] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:04.911873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134621c2-45d9-4632-a8ee-34a37ea3986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:04.912524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134621c2-45d9-4632-a8ee-34a37ea3986b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.912805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134621c2-45d9-4632-a8ee-34a37ea3986b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.913079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134621c2-45d9-4632-a8ee-34a37ea3986b None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.913718 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134621c2-45d9-4632-a8ee-34a37ea3986b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:04.914019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134621c2-45d9-4632-a8ee-34a37ea3986b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:04.918850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134621c2-45d9-4632-a8ee-34a37ea3986b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:04.923272 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 357/696] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:12:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:04.934761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe787d-ae82-4017-a81e-86a35a57146d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.018407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:05.034467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe787d-ae82-4017-a81e-86a35a57146d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.066218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134621c2-45d9-4632-a8ee-34a37ea3986b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.071626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac4774-b608-46ed-9d32-20f6e40f5bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.072254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac4774-b608-46ed-9d32-20f6e40f5bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.072530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac4774-b608-46ed-9d32-20f6e40f5bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.072840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac4774-b608-46ed-9d32-20f6e40f5bd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.073541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac4774-b608-46ed-9d32-20f6e40f5bd6 None admin] RBAC: Adding query filter params (interface=public, service_id=7d1addeb8bd44eed85c7ece37a75493b, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:05.073844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac4774-b608-46ed-9d32-20f6e40f5bd6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.075287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac4774-b608-46ed-9d32-20f6e40f5bd6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.081129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 340/697] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Oct 27 01:12:04 2022] GET /identity/v3/endpoints?service_id=7d1addeb8bd44eed85c7ece37a75493b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:05.086777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac4774-b608-46ed-9d32-20f6e40f5bd6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.140995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:05.173332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134621c2-45d9-4632-a8ee-34a37ea3986b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.214414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782918ef-64d1-401c-8850-4893974f0788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.215099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782918ef-64d1-401c-8850-4893974f0788 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.215400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782918ef-64d1-401c-8850-4893974f0788 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.215637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782918ef-64d1-401c-8850-4893974f0788 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.216260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782918ef-64d1-401c-8850-4893974f0788 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.217611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782918ef-64d1-401c-8850-4893974f0788 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.218913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac4774-b608-46ed-9d32-20f6e40f5bd6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-782918ef-64d1-401c-8850-4893974f0788 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:05.226492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:05.227806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:05.228764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 358/698] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:12:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:12:05.229716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782918ef-64d1-401c-8850-4893974f0788 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.263009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785fca1-0690-4026-bab6-c13350f45fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.263623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785fca1-0690-4026-bab6-c13350f45fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.263900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785fca1-0690-4026-bab6-c13350f45fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.264166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785fca1-0690-4026-bab6-c13350f45fe1 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.264771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785fca1-0690-4026-bab6-c13350f45fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.266193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785fca1-0690-4026-bab6-c13350f45fe1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.272627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 341/699] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Oct 27 01:12:05 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:12:05.273457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785fca1-0690-4026-bab6-c13350f45fe1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.291652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:05.368247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782918ef-64d1-401c-8850-4893974f0788 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.403495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785fca1-0690-4026-bab6-c13350f45fe1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.408247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ad709-8956-4a3e-8b9e-85bb1ac1a226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.408247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ad709-8956-4a3e-8b9e-85bb1ac1a226 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.408554 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ad709-8956-4a3e-8b9e-85bb1ac1a226 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.408554 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ad709-8956-4a3e-8b9e-85bb1ac1a226 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.409191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ad709-8956-4a3e-8b9e-85bb1ac1a226 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.410574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ad709-8956-4a3e-8b9e-85bb1ac1a226 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.414130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ac4ad709-8956-4a3e-8b9e-85bb1ac1a226 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:05.421677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:05.423038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:05.424374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 359/700] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Oct 27 01:12:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:05.428846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ad709-8956-4a3e-8b9e-85bb1ac1a226 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.458173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a2e4-7a8f-4c06-bef5-e49128c8be33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.459502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a2e4-7a8f-4c06-bef5-e49128c8be33 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.460219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a2e4-7a8f-4c06-bef5-e49128c8be33 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.460756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a2e4-7a8f-4c06-bef5-e49128c8be33 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.461856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438a2e4-7a8f-4c06-bef5-e49128c8be33 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:05.462603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438a2e4-7a8f-4c06-bef5-e49128c8be33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.464471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438a2e4-7a8f-4c06-bef5-e49128c8be33 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.471616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 342/701] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:12:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:05.477973 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a2e4-7a8f-4c06-bef5-e49128c8be33 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.542499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ad709-8956-4a3e-8b9e-85bb1ac1a226 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.583604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849ddbb-5907-4699-aec9-017effb9d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.584644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849ddbb-5907-4699-aec9-017effb9d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.584931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849ddbb-5907-4699-aec9-017effb9d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.585200 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849ddbb-5907-4699-aec9-017effb9d5e5 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.585859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849ddbb-5907-4699-aec9-017effb9d5e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:05.586158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849ddbb-5907-4699-aec9-017effb9d5e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.588122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849ddbb-5907-4699-aec9-017effb9d5e5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.589470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:05.594182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 360/702] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:12:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:05.599533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849ddbb-5907-4699-aec9-017effb9d5e5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.617930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a2e4-7a8f-4c06-bef5-e49128c8be33 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.658178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08692c29-356c-4d83-abb3-ba1c1160ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.659135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08692c29-356c-4d83-abb3-ba1c1160ab42 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.659618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08692c29-356c-4d83-abb3-ba1c1160ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.660044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08692c29-356c-4d83-abb3-ba1c1160ab42 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.660934 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08692c29-356c-4d83-abb3-ba1c1160ab42 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:05.661490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08692c29-356c-4d83-abb3-ba1c1160ab42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.663012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08692c29-356c-4d83-abb3-ba1c1160ab42 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.664366 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:05.671343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 343/703] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:12:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:05.679685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08692c29-356c-4d83-abb3-ba1c1160ab42 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.714261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849ddbb-5907-4699-aec9-017effb9d5e5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.759423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80593d3-2afd-4d9b-b08d-31a21d6399ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.760768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80593d3-2afd-4d9b-b08d-31a21d6399ce None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.761600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80593d3-2afd-4d9b-b08d-31a21d6399ce None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.762027 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80593d3-2afd-4d9b-b08d-31a21d6399ce None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.763527 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80593d3-2afd-4d9b-b08d-31a21d6399ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:05.763979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80593d3-2afd-4d9b-b08d-31a21d6399ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.766257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80593d3-2afd-4d9b-b08d-31a21d6399ce None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.773388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 361/704] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:12:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:05.778697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80593d3-2afd-4d9b-b08d-31a21d6399ce None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.789140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08692c29-356c-4d83-abb3-ba1c1160ab42 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.824958 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dac0b3-cf3a-40eb-ba85-0e0b0cec40e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.825486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dac0b3-cf3a-40eb-ba85-0e0b0cec40e3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.825771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dac0b3-cf3a-40eb-ba85-0e0b0cec40e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.826042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dac0b3-cf3a-40eb-ba85-0e0b0cec40e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.826780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dac0b3-cf3a-40eb-ba85-0e0b0cec40e3 None admin] RBAC: Adding query filter params (interface=public, service_id=1c28186df8354556861b08238486c6dc, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:05.827095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dac0b3-cf3a-40eb-ba85-0e0b0cec40e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.828461 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dac0b3-cf3a-40eb-ba85-0e0b0cec40e3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.837050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 344/705] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Oct 27 01:12:05 2022] GET /identity/v3/endpoints?service_id=1c28186df8354556861b08238486c6dc&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:05.842542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dac0b3-cf3a-40eb-ba85-0e0b0cec40e3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.857646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:05.923974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80593d3-2afd-4d9b-b08d-31a21d6399ce None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.955961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:05.965933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef2aa-4848-4781-b419-e1b5c7cb5907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.966553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef2aa-4848-4781-b419-e1b5c7cb5907 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.966862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef2aa-4848-4781-b419-e1b5c7cb5907 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.967133 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef2aa-4848-4781-b419-e1b5c7cb5907 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.967523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dac0b3-cf3a-40eb-ba85-0e0b0cec40e3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.967806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef2aa-4848-4781-b419-e1b5c7cb5907 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.969167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef2aa-4848-4781-b419-e1b5c7cb5907 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:06.002742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 362/706] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:12:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:06.023244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d146600-0271-42e1-9abe-0851357117a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:06.023920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d146600-0271-42e1-9abe-0851357117a5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:06.024213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d146600-0271-42e1-9abe-0851357117a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:06.024486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d146600-0271-42e1-9abe-0851357117a5 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:06.025113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d146600-0271-42e1-9abe-0851357117a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:06.026520 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d146600-0271-42e1-9abe-0851357117a5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:06.033888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 345/707] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Oct 27 01:12:05 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:12:06.920932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a91474-932b-40f0-b678-9a4285c349a5 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:06.921464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a91474-932b-40f0-b678-9a4285c349a5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:06.921464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a91474-932b-40f0-b678-9a4285c349a5 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:06.923118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 363/708] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:06.928472 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5b41a-eebc-4d2e-acd2-f8f9a19c6650 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:06.928886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5b41a-eebc-4d2e-acd2-f8f9a19c6650 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:06.929057 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5b41a-eebc-4d2e-acd2-f8f9a19c6650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:06.948077 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a0e5b41a-eebc-4d2e-acd2-f8f9a19c6650 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:06.949284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a0e5b41a-eebc-4d2e-acd2-f8f9a19c6650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:07.019880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:07.028220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 346/709] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:07.290809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a91474-932b-40f0-b678-9a4285c349a5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:07.393866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a91474-932b-40f0-b678-9a4285c349a5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:07.431658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873eb4-17dc-4eae-b21a-64d1ad3dd320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:07.432317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873eb4-17dc-4eae-b21a-64d1ad3dd320 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.432589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873eb4-17dc-4eae-b21a-64d1ad3dd320 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.432862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873eb4-17dc-4eae-b21a-64d1ad3dd320 None admin] PATH_INFO: `/v3/services/image` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.433459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae873eb4-17dc-4eae-b21a-64d1ad3dd320 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:07.434854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae873eb4-17dc-4eae-b21a-64d1ad3dd320 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ae873eb4-17dc-4eae-b21a-64d1ad3dd320 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:07.443816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:07.444782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:07.446260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 364/710] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Oct 27 01:12:07 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:07.453432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5b41a-eebc-4d2e-acd2-f8f9a19c6650 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:07.517695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189790b-afba-42c7-bd4d-728b7645f396 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.518026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189790b-afba-42c7-bd4d-728b7645f396 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.518254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189790b-afba-42c7-bd4d-728b7645f396 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.519802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 365/711] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:07.524796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507d90-3318-4d3d-b564-a6ad14586d98 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.525073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507d90-3318-4d3d-b564-a6ad14586d98 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.525359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507d90-3318-4d3d-b564-a6ad14586d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.543785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-dd507d90-3318-4d3d-b564-a6ad14586d98 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:07.544909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dd507d90-3318-4d3d-b564-a6ad14586d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:07.566544 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5b41a-eebc-4d2e-acd2-f8f9a19c6650 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:07.595111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:07.609837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5bfb0-7ae7-4286-aeaa-5873d07135b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:07.610811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5bfb0-7ae7-4286-aeaa-5873d07135b8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.611335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5bfb0-7ae7-4286-aeaa-5873d07135b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.611793 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5bfb0-7ae7-4286-aeaa-5873d07135b8 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.612628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5bfb0-7ae7-4286-aeaa-5873d07135b8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:07.613118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5bfb0-7ae7-4286-aeaa-5873d07135b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:07.614919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5bfb0-7ae7-4286-aeaa-5873d07135b8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:07.620606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 347/712] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:07.626660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5bfb0-7ae7-4286-aeaa-5873d07135b8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:07.632216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 366/713] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:07.689070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:07.731069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5bfb0-7ae7-4286-aeaa-5873d07135b8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:07.767312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb771-1079-4d91-9be5-ec064fee0f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:07.768337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb771-1079-4d91-9be5-ec064fee0f03 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.768818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb771-1079-4d91-9be5-ec064fee0f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.769287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb771-1079-4d91-9be5-ec064fee0f03 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.770135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb771-1079-4d91-9be5-ec064fee0f03 None admin] RBAC: Adding query filter params (type=image) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:07.770658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb771-1079-4d91-9be5-ec064fee0f03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:07.772406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb771-1079-4d91-9be5-ec064fee0f03 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:07.782365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 348/714] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:07.910225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd507d90-3318-4d3d-b564-a6ad14586d98 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:08.015134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd507d90-3318-4d3d-b564-a6ad14586d98 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:08.049181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7816a7-d19a-458c-9cc0-5c182050fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:08.049814 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7816a7-d19a-458c-9cc0-5c182050fb08 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:08.050087 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7816a7-d19a-458c-9cc0-5c182050fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:08.050350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7816a7-d19a-458c-9cc0-5c182050fb08 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:08.050959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7816a7-d19a-458c-9cc0-5c182050fb08 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:08.052317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7816a7-d19a-458c-9cc0-5c182050fb08 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ff7816a7-d19a-458c-9cc0-5c182050fb08 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:08.061295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:08.062276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:08.063515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 367/715] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:12:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:08.068657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb771-1079-4d91-9be5-ec064fee0f03 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:08.186608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb771-1079-4d91-9be5-ec064fee0f03 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:08.212995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:08.224257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fc30c-5bf0-4389-82ff-94e8a42600d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:08.224951 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fc30c-5bf0-4389-82ff-94e8a42600d6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:08.225237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fc30c-5bf0-4389-82ff-94e8a42600d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:08.225630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fc30c-5bf0-4389-82ff-94e8a42600d6 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:08.226286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fc30c-5bf0-4389-82ff-94e8a42600d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:08.226823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fc30c-5bf0-4389-82ff-94e8a42600d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:08.228437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fc30c-5bf0-4389-82ff-94e8a42600d6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:08.233937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 349/716] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:12:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:08.239618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7816a7-d19a-458c-9cc0-5c182050fb08 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:08.276185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0de71f-5423-42ca-b4fd-e9cc3679f5d1 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:08.276713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0de71f-5423-42ca-b4fd-e9cc3679f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:08.276994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0de71f-5423-42ca-b4fd-e9cc3679f5d1 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:08.279680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 350/717] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:08.284878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1b1d-b64b-40e7-b483-75b3d857a418 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:08.285162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1b1d-b64b-40e7-b483-75b3d857a418 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:08.285441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1b1d-b64b-40e7-b483-75b3d857a418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:08.288088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:08.313356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e58c1b1d-b64b-40e7-b483-75b3d857a418 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:08.314863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e58c1b1d-b64b-40e7-b483-75b3d857a418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:08.346460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7816a7-d19a-458c-9cc0-5c182050fb08 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:08.381514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9ec1-b4e3-4d9c-bfcf-32ff5d41f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:08.382135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9ec1-b4e3-4d9c-bfcf-32ff5d41f55e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:08.382412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9ec1-b4e3-4d9c-bfcf-32ff5d41f55e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:08.382686 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9ec1-b4e3-4d9c-bfcf-32ff5d41f55e None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:08.383386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce9ec1-b4e3-4d9c-bfcf-32ff5d41f55e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:08.383698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce9ec1-b4e3-4d9c-bfcf-32ff5d41f55e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:08.385057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce9ec1-b4e3-4d9c-bfcf-32ff5d41f55e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:08.398886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 368/718] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Oct 27 01:12:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:08.398886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5d9da-1b2b-4016-9971-a909f0c9abc0 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:08.398886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5d9da-1b2b-4016-9971-a909f0c9abc0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:08.398886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5d9da-1b2b-4016-9971-a909f0c9abc0 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:08.398886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 369/719] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:08.398886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5d9da-1b2b-4016-9971-a909f0c9abc0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:08.416448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 351/720] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:08.417956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c93c5-a2de-48cb-9fcd-6fe8008450dd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:08.418245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c93c5-a2de-48cb-9fcd-6fe8008450dd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:08.418520 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c93c5-a2de-48cb-9fcd-6fe8008450dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:08.447806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1b3c93c5-a2de-48cb-9fcd-6fe8008450dd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:08.449342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1b3c93c5-a2de-48cb-9fcd-6fe8008450dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:08.507328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5d9da-1b2b-4016-9971-a909f0c9abc0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:08.515499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:08.535149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 352/721] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:08.549098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f866f7-bf02-48e1-bec6-aa8204e7d328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:08.549722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f866f7-bf02-48e1-bec6-aa8204e7d328 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:08.550006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f866f7-bf02-48e1-bec6-aa8204e7d328 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:08.550310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f866f7-bf02-48e1-bec6-aa8204e7d328 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:08.551061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f866f7-bf02-48e1-bec6-aa8204e7d328 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:08.552483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f866f7-bf02-48e1-bec6-aa8204e7d328 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:08.574696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 370/722] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:12:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:08.723361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c93c5-a2de-48cb-9fcd-6fe8008450dd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:08.781181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:08.811549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f866f7-bf02-48e1-bec6-aa8204e7d328 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:08.843517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c93c5-a2de-48cb-9fcd-6fe8008450dd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:08.885813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668bdb-6bf6-4933-849c-9b9af78e3ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:08.886467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668bdb-6bf6-4933-849c-9b9af78e3ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:08.886855 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668bdb-6bf6-4933-849c-9b9af78e3ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:08.887076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51668bdb-6bf6-4933-849c-9b9af78e3ca7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:08.888010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51668bdb-6bf6-4933-849c-9b9af78e3ca7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:08.889377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51668bdb-6bf6-4933-849c-9b9af78e3ca7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-51668bdb-6bf6-4933-849c-9b9af78e3ca7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:08.898680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:08.899731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:08.900566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:08.903600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 353/723] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:12:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:08.906309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668bdb-6bf6-4933-849c-9b9af78e3ca7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:08.957029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f866f7-bf02-48e1-bec6-aa8204e7d328 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:09.002991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29873b-9940-4474-819f-12f1377667ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:09.004647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29873b-9940-4474-819f-12f1377667ea None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:09.005150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29873b-9940-4474-819f-12f1377667ea None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:09.005860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29873b-9940-4474-819f-12f1377667ea None admin] PATH_INFO: `/v3/services/compute` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:09.007082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29873b-9940-4474-819f-12f1377667ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:09.009195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29873b-9940-4474-819f-12f1377667ea None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:09.012506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51668bdb-6bf6-4933-849c-9b9af78e3ca7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-be29873b-9940-4474-819f-12f1377667ea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:09.021372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:09.022709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:12:09.023570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:09.024359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 371/724] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:12:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:09.030198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29873b-9940-4474-819f-12f1377667ea None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:09.030746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:09.063157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:09.071448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af37d2-a367-4ced-8e3e-4782367a431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:09.073417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af37d2-a367-4ced-8e3e-4782367a431d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:09.073871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af37d2-a367-4ced-8e3e-4782367a431d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:09.074287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af37d2-a367-4ced-8e3e-4782367a431d None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:09.075125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af37d2-a367-4ced-8e3e-4782367a431d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:09.075567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af37d2-a367-4ced-8e3e-4782367a431d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:09.077066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af37d2-a367-4ced-8e3e-4782367a431d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:09.085078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 354/725] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:12:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:09.090976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af37d2-a367-4ced-8e3e-4782367a431d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:09.152512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29873b-9940-4474-819f-12f1377667ea None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:09.187439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c7ac2-9597-4439-bbf3-6743f55ad4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:09.188141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c7ac2-9597-4439-bbf3-6743f55ad4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:09.188512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c7ac2-9597-4439-bbf3-6743f55ad4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:09.188846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c7ac2-9597-4439-bbf3-6743f55ad4f4 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:09.189543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c7ac2-9597-4439-bbf3-6743f55ad4f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:09.189906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c7ac2-9597-4439-bbf3-6743f55ad4f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:09.192081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c7ac2-9597-4439-bbf3-6743f55ad4f4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:09.202130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 372/726] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:12:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:09.203158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c7ac2-9597-4439-bbf3-6743f55ad4f4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:09.229047 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af37d2-a367-4ced-8e3e-4782367a431d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:09.264544 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935c98-f4de-4a0b-82c1-a18a181082b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:09.265124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935c98-f4de-4a0b-82c1-a18a181082b1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:09.265400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935c98-f4de-4a0b-82c1-a18a181082b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:09.265665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935c98-f4de-4a0b-82c1-a18a181082b1 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:09.266315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935c98-f4de-4a0b-82c1-a18a181082b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:09.266775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935c98-f4de-4a0b-82c1-a18a181082b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:09.268688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935c98-f4de-4a0b-82c1-a18a181082b1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:09.278782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 355/727] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:12:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:09.281195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935c98-f4de-4a0b-82c1-a18a181082b1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:09.326111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:09.328538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:09.340635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c7ac2-9597-4439-bbf3-6743f55ad4f4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:09.382919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232a988-048b-4e47-9103-517ba386befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:09.383666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232a988-048b-4e47-9103-517ba386befe None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:09.384021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232a988-048b-4e47-9103-517ba386befe None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:09.384752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232a988-048b-4e47-9103-517ba386befe None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:09.385477 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232a988-048b-4e47-9103-517ba386befe None admin] RBAC: Adding query filter params (type=compute) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:09.386081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232a988-048b-4e47-9103-517ba386befe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:09.388060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232a988-048b-4e47-9103-517ba386befe None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:09.394816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 373/728] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:12:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:09.411422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935c98-f4de-4a0b-82c1-a18a181082b1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:09.450324 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e764-0ade-47a0-9fa8-c9b56af4caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:09.451338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e764-0ade-47a0-9fa8-c9b56af4caa5 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:09.451822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e764-0ade-47a0-9fa8-c9b56af4caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:09.452259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e764-0ade-47a0-9fa8-c9b56af4caa5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:09.453110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0e764-0ade-47a0-9fa8-c9b56af4caa5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:09.454656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0e764-0ade-47a0-9fa8-c9b56af4caa5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:09.482344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 356/729] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:12:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:10.057953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbaff0-6268-45f4-b26a-58113759555e None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:10.058485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbaff0-6268-45f4-b26a-58113759555e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:10.058485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbaff0-6268-45f4-b26a-58113759555e None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:10.060175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 374/730] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:10.065692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0a0d4-b807-4a62-a82e-516e35d1b0df None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:10.065988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0a0d4-b807-4a62-a82e-516e35d1b0df None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:10.066325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0a0d4-b807-4a62-a82e-516e35d1b0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:10.085388 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-71a0a0d4-b807-4a62-a82e-516e35d1b0df None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:10.086753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-71a0a0d4-b807-4a62-a82e-516e35d1b0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:10.168646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 357/731] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:10.445307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbaff0-6268-45f4-b26a-58113759555e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:10.552657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbaff0-6268-45f4-b26a-58113759555e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:10.586120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13272216-f11c-4efb-82f7-c92fcc03c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:10.586917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13272216-f11c-4efb-82f7-c92fcc03c4e9 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:10.587194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13272216-f11c-4efb-82f7-c92fcc03c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:10.587465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13272216-f11c-4efb-82f7-c92fcc03c4e9 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:10.588131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13272216-f11c-4efb-82f7-c92fcc03c4e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:10.589478 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13272216-f11c-4efb-82f7-c92fcc03c4e9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:10.607379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 375/732] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:12:10 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:10.826317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbea05b-bb0e-43e4-b4ea-1603015fd6ab None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:10.826968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbea05b-bb0e-43e4-b4ea-1603015fd6ab None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:10.827438 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbea05b-bb0e-43e4-b4ea-1603015fd6ab None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:10.829225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 358/733] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:10.834997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef3c9-0689-4412-9d9b-55003e02250a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:10.835517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef3c9-0689-4412-9d9b-55003e02250a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:10.835801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef3c9-0689-4412-9d9b-55003e02250a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:10.854160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9f5ef3c9-0689-4412-9d9b-55003e02250a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:10.855577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9f5ef3c9-0689-4412-9d9b-55003e02250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:10.865472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:10.934014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 376/734] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:11.195559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbea05b-bb0e-43e4-b4ea-1603015fd6ab None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:11.215969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:11.304254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbea05b-bb0e-43e4-b4ea-1603015fd6ab None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:11.340296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:11.341165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:11.341611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:11.342023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:11.342860 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:11.344440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:11.347244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING keystone.server.flask.common [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 01:12:11.368674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.sql.core [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 01:12:11.368674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 01:12:11.368674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [parameters: {'id': '923d7614c1824bf1b11723d6da0e40a8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 01:12:11.368674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81615) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 923d7614c1824bf1b11723d6da0e40a8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 923d7614c1824bf1b11723d6da0e40a8. Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:12:11.377307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 01:12:11.378270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application yield resource Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise self.value Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application session.commit() Oct 27 01:12:11.379523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.flush() Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application compat.raise_( Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 01:12:11.380737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 01:12:11.381706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:12:11.382494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [parameters: {'id': '923d7614c1824bf1b11723d6da0e40a8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:11.383530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:11.384496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:11.385656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:11.385656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 27 01:12:11.385656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 27 01:12:11.385656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:11.385656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:11.385656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 01:12:11.385656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 01:12:11.385656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 923d7614c1824bf1b11723d6da0e40a8. Oct 27 01:12:11.385656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:11.388302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 359/735] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Oct 27 01:12:11 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:11.394780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef3c9-0689-4412-9d9b-55003e02250a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:11.494021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef3c9-0689-4412-9d9b-55003e02250a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:11.530628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede49e0-a182-4a68-ac1d-637aee60dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:11.531335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede49e0-a182-4a68-ac1d-637aee60dd70 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:11.531614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede49e0-a182-4a68-ac1d-637aee60dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:11.531957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede49e0-a182-4a68-ac1d-637aee60dd70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:11.539927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede49e0-a182-4a68-ac1d-637aee60dd70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:11.541421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede49e0-a182-4a68-ac1d-637aee60dd70 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:11.544777 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-9ede49e0-a182-4a68-ac1d-637aee60dd70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:12:11.555234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:11.556172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:11.557055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:12:11.557055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:12:11.557055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:12:11.557055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:12:11.557055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:12:11.557055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:12:11.557055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:12:11.557055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:11.557055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 377/736] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:11.563007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:11.640014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e1024-4ac5-47cd-a699-405e71117d66 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:11.640295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e1024-4ac5-47cd-a699-405e71117d66 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:11.640559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e1024-4ac5-47cd-a699-405e71117d66 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:11.642323 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 378/737] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:11.647297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:11.648297 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3470d-8670-4216-8177-d0cc6339f9ae None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:11.648584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3470d-8670-4216-8177-d0cc6339f9ae None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:11.648918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3470d-8670-4216-8177-d0cc6339f9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:11.672727 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-66c3470d-8670-4216-8177-d0cc6339f9ae None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:11.673951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-66c3470d-8670-4216-8177-d0cc6339f9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:11.680475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5fef9-563c-4388-a0c3-9fbde636471d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:11.726019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bf5ac-d19c-43b3-963a-0d9c832e1d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:11.726773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bf5ac-d19c-43b3-963a-0d9c832e1d21 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:11.727051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bf5ac-d19c-43b3-963a-0d9c832e1d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:11.727251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bf5ac-d19c-43b3-963a-0d9c832e1d21 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:11.727920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bf5ac-d19c-43b3-963a-0d9c832e1d21 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:11.728219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bf5ac-d19c-43b3-963a-0d9c832e1d21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:11.729835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bf5ac-d19c-43b3-963a-0d9c832e1d21 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:11.745208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 379/738] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:11.752256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 360/739] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:12:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:11.766971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a34c-6525-4431-b6ad-68b518c1f914 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:11.767656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a34c-6525-4431-b6ad-68b518c1f914 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:11.768132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a34c-6525-4431-b6ad-68b518c1f914 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:11.770103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 380/740] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:11.777177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360022b-f136-43e5-9050-d1594f7700f0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:11.777812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360022b-f136-43e5-9050-d1594f7700f0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:11.778288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360022b-f136-43e5-9050-d1594f7700f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:11.799297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1360022b-f136-43e5-9050-d1594f7700f0 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:11.801257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1360022b-f136-43e5-9050-d1594f7700f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:11.895733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 361/741] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:12.011307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a34c-6525-4431-b6ad-68b518c1f914 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:12.117384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a34c-6525-4431-b6ad-68b518c1f914 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:12.155103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:12.159157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56399d-d4fc-4c64-a017-5f6ad87c0ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:12.159782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56399d-d4fc-4c64-a017-5f6ad87c0ef8 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.160063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56399d-d4fc-4c64-a017-5f6ad87c0ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.160342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56399d-d4fc-4c64-a017-5f6ad87c0ef8 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.161006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56399d-d4fc-4c64-a017-5f6ad87c0ef8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:12.162386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56399d-d4fc-4c64-a017-5f6ad87c0ef8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:12.175470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360022b-f136-43e5-9050-d1594f7700f0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:12.181382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 381/742] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:12:12 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:12.248614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:12.294457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360022b-f136-43e5-9050-d1594f7700f0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:12.339764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db159a27-7b33-4540-a63f-414e2842e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:12.340419 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db159a27-7b33-4540-a63f-414e2842e293 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.340695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db159a27-7b33-4540-a63f-414e2842e293 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.340966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db159a27-7b33-4540-a63f-414e2842e293 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.341558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db159a27-7b33-4540-a63f-414e2842e293 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:12.342973 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db159a27-7b33-4540-a63f-414e2842e293 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-db159a27-7b33-4540-a63f-414e2842e293 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:12.353103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:12.354143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:12.355428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 362/743] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:12:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:12:12.362932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56399d-d4fc-4c64-a017-5f6ad87c0ef8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:12.468877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56399d-d4fc-4c64-a017-5f6ad87c0ef8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:12.505576 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f6714-b83b-4734-943f-a16165291b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:12.506557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f6714-b83b-4734-943f-a16165291b74 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.507073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f6714-b83b-4734-943f-a16165291b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.507550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f6714-b83b-4734-943f-a16165291b74 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.508602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f6714-b83b-4734-943f-a16165291b74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:12.509101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f6714-b83b-4734-943f-a16165291b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:12.510668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f6714-b83b-4734-943f-a16165291b74 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:12.521421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 382/744] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:12:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:12.523187 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db159a27-7b33-4540-a63f-414e2842e293 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:12.629512 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db159a27-7b33-4540-a63f-414e2842e293 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:12.654048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:12.665498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cb3e5-2fce-486a-97bb-4e3a02d0e92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:12.666578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cb3e5-2fce-486a-97bb-4e3a02d0e92b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.667303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cb3e5-2fce-486a-97bb-4e3a02d0e92b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.667641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cb3e5-2fce-486a-97bb-4e3a02d0e92b None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.668267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cb3e5-2fce-486a-97bb-4e3a02d0e92b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:12.668570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cb3e5-2fce-486a-97bb-4e3a02d0e92b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:12.670036 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cb3e5-2fce-486a-97bb-4e3a02d0e92b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:12.675624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 363/745] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:12:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:12.681517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f6714-b83b-4734-943f-a16165291b74 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:12.743406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:12.791115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f6714-b83b-4734-943f-a16165291b74 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:12.826636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1c9fa-eb1c-4ce9-801b-13eed3e368e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:12.827312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1c9fa-eb1c-4ce9-801b-13eed3e368e2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.827587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1c9fa-eb1c-4ce9-801b-13eed3e368e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.827852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1c9fa-eb1c-4ce9-801b-13eed3e368e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.828592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1c9fa-eb1c-4ce9-801b-13eed3e368e2 None admin] RBAC: Adding query filter params (interface=admin, service_id=1c28186df8354556861b08238486c6dc, region_id=RegionOne) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:12.828891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1c9fa-eb1c-4ce9-801b-13eed3e368e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:12.830384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1c9fa-eb1c-4ce9-801b-13eed3e368e2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:12.837017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 383/746] 10.222.0.23 () {56 vars in 1249 bytes} [Thu Oct 27 01:12:12 2022] GET /identity/v3/endpoints?service_id=1c28186df8354556861b08238486c6dc&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:12.843129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cb3e5-2fce-486a-97bb-4e3a02d0e92b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:12.936442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d2b83-cce2-4d76-bf51-48652915cf8a None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.936626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d2b83-cce2-4d76-bf51-48652915cf8a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.936910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d2b83-cce2-4d76-bf51-48652915cf8a None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.938510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 384/747] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:12.943623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275ff50-b4fe-47b2-a40b-04adc5e96bdd None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.943902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275ff50-b4fe-47b2-a40b-04adc5e96bdd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.944174 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275ff50-b4fe-47b2-a40b-04adc5e96bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.948073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cb3e5-2fce-486a-97bb-4e3a02d0e92b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:12.962963 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7275ff50-b4fe-47b2-a40b-04adc5e96bdd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:12.964163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7275ff50-b4fe-47b2-a40b-04adc5e96bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:12.983975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94388957-f0c2-41fa-a018-11a8b8f8f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:12.984607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94388957-f0c2-41fa-a018-11a8b8f8f665 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.985370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94388957-f0c2-41fa-a018-11a8b8f8f665 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.985663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94388957-f0c2-41fa-a018-11a8b8f8f665 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.986421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94388957-f0c2-41fa-a018-11a8b8f8f665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:12.988228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94388957-f0c2-41fa-a018-11a8b8f8f665 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:12.998249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 364/748] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Oct 27 01:12:12 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:12:13.043451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 385/749] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:13.311747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94388957-f0c2-41fa-a018-11a8b8f8f665 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:13.374211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:13.414166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94388957-f0c2-41fa-a018-11a8b8f8f665 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:13.448489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcd33e-8452-48ef-b7dd-f70883bb134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:13.449139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcd33e-8452-48ef-b7dd-f70883bb134f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:13.449422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcd33e-8452-48ef-b7dd-f70883bb134f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:13.449691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcd33e-8452-48ef-b7dd-f70883bb134f None admin] PATH_INFO: `/v3/services/image` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:13.450283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcd33e-8452-48ef-b7dd-f70883bb134f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:13.451683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcd33e-8452-48ef-b7dd-f70883bb134f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-75dcd33e-8452-48ef-b7dd-f70883bb134f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:13.460865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:13.461935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:13.463456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 365/750] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Oct 27 01:12:13 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:13.468407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275ff50-b4fe-47b2-a40b-04adc5e96bdd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:13.518560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:13.570127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275ff50-b4fe-47b2-a40b-04adc5e96bdd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:13.605028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ef2c3-9d85-4f13-9a1e-89be34ae5138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:13.605656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ef2c3-9d85-4f13-9a1e-89be34ae5138 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:13.605937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ef2c3-9d85-4f13-9a1e-89be34ae5138 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:13.606209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ef2c3-9d85-4f13-9a1e-89be34ae5138 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:13.606886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ef2c3-9d85-4f13-9a1e-89be34ae5138 None admin] RBAC: Adding query filter params (name=image) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:13.607189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ef2c3-9d85-4f13-9a1e-89be34ae5138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:13.608631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ef2c3-9d85-4f13-9a1e-89be34ae5138 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:13.614052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 386/751] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:13.619872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcd33e-8452-48ef-b7dd-f70883bb134f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:13.725283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcd33e-8452-48ef-b7dd-f70883bb134f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:13.742682 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:13.761389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58160fb4-38a9-47b1-a2d1-6e71e4f5fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:13.762016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58160fb4-38a9-47b1-a2d1-6e71e4f5fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:13.762297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58160fb4-38a9-47b1-a2d1-6e71e4f5fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:13.763007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58160fb4-38a9-47b1-a2d1-6e71e4f5fcd8 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:13.763653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58160fb4-38a9-47b1-a2d1-6e71e4f5fcd8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:13.763961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58160fb4-38a9-47b1-a2d1-6e71e4f5fcd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:13.765347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58160fb4-38a9-47b1-a2d1-6e71e4f5fcd8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:13.770699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 366/752] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:13.776416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ef2c3-9d85-4f13-9a1e-89be34ae5138 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:13.888159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ef2c3-9d85-4f13-9a1e-89be34ae5138 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:13.901883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:13.923156 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ed40f-3052-45c8-986f-2c14381c14f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:13.923798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ed40f-3052-45c8-986f-2c14381c14f1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:13.924079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ed40f-3052-45c8-986f-2c14381c14f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:13.924355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ed40f-3052-45c8-986f-2c14381c14f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:13.925088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ed40f-3052-45c8-986f-2c14381c14f1 None admin] RBAC: Adding query filter params (interface=public, service_id=505675e451084151a41ce02076f9f96f, region_id=RegionOne) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:13.925400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ed40f-3052-45c8-986f-2c14381c14f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:13.926839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ed40f-3052-45c8-986f-2c14381c14f1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:13.933471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 387/753] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Oct 27 01:12:13 2022] GET /identity/v3/endpoints?service_id=505675e451084151a41ce02076f9f96f&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:13.939374 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58160fb4-38a9-47b1-a2d1-6e71e4f5fcd8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:13.973447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c46e1-e6b4-461a-89f9-5159cb949bfd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:13.973759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c46e1-e6b4-461a-89f9-5159cb949bfd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:13.974002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c46e1-e6b4-461a-89f9-5159cb949bfd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:13.975638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 388/754] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:13.980633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb82aaa-7436-4a82-911d-ffb121730c91 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:13.980919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb82aaa-7436-4a82-911d-ffb121730c91 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:13.981192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb82aaa-7436-4a82-911d-ffb121730c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:14.000100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7fb82aaa-7436-4a82-911d-ffb121730c91 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:14.001288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7fb82aaa-7436-4a82-911d-ffb121730c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:14.052064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58160fb4-38a9-47b1-a2d1-6e71e4f5fcd8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:14.076484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 389/755] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:13 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:14.089931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2ce9e-a58d-4234-9b18-95cb97087d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:14.090553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ce9e-a58d-4234-9b18-95cb97087d9e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:14.090869 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ce9e-a58d-4234-9b18-95cb97087d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:14.091146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ce9e-a58d-4234-9b18-95cb97087d9e None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:14.091761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2ce9e-a58d-4234-9b18-95cb97087d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:14.093253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2ce9e-a58d-4234-9b18-95cb97087d9e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:14.100215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 367/756] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Oct 27 01:12:13 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:12:14.347475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb82aaa-7436-4a82-911d-ffb121730c91 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:14.446907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb82aaa-7436-4a82-911d-ffb121730c91 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:14.454357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:14.487234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1391ff-2223-46c5-ad02-fcb527084987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:14.487886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1391ff-2223-46c5-ad02-fcb527084987 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:14.488170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1391ff-2223-46c5-ad02-fcb527084987 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:14.488450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1391ff-2223-46c5-ad02-fcb527084987 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:14.489166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1391ff-2223-46c5-ad02-fcb527084987 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:14.490669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1391ff-2223-46c5-ad02-fcb527084987 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:14.493747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING keystone.server.flask.common [None req-0b1391ff-2223-46c5-ad02-fcb527084987 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 01:12:14.509910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.sql.core [None req-0b1391ff-2223-46c5-ad02-fcb527084987 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 01:12:14.509910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 01:12:14.509910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [parameters: {'user_id': '1289731803d9472db936fadc86bbc5e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 01:12:14.509910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81616) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-0b1391ff-2223-46c5-ad02-fcb527084987 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application result.read() Oct 27 01:12:14.517613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:12:14.518565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application yield resource Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise self.value Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application session.commit() Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 01:12:14.519968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.session.flush() Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application compat.raise_( Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 01:12:14.520862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:12:14.521748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application result.read() Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:12:14.522590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [parameters: {'user_id': '1289731803d9472db936fadc86bbc5e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:14.525375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 27 01:12:14.531472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 27 01:12:14.533598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 27 01:12:14.533598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 27 01:12:14.533598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 01:12:14.533598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 01:12:14.533598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 01:12:14.533598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:14.533598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 390/757] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Oct 27 01:12:14 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:14.537236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2ce9e-a58d-4234-9b18-95cb97087d9e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:14.584721 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:14.624791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a342-dfd2-4ab5-8b03-fecfd844c2e9 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:14.625088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a342-dfd2-4ab5-8b03-fecfd844c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:14.625269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a342-dfd2-4ab5-8b03-fecfd844c2e9 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:14.630532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 391/758] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:14.636128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67828-6218-46ef-8735-b148a097373f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:14.636675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67828-6218-46ef-8735-b148a097373f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:14.637151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67828-6218-46ef-8735-b148a097373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:14.643988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2ce9e-a58d-4234-9b18-95cb97087d9e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:14.657023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-60d67828-6218-46ef-8735-b148a097373f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:14.659111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-60d67828-6218-46ef-8735-b148a097373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:14.679277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308862c-26ef-4ac2-9e8f-b28f5fa1a42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:14.679949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308862c-26ef-4ac2-9e8f-b28f5fa1a42e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:14.680311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308862c-26ef-4ac2-9e8f-b28f5fa1a42e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:14.680584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308862c-26ef-4ac2-9e8f-b28f5fa1a42e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:14.688169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308862c-26ef-4ac2-9e8f-b28f5fa1a42e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:14.689548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308862c-26ef-4ac2-9e8f-b28f5fa1a42e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-2308862c-26ef-4ac2-9e8f-b28f5fa1a42e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:12:14.704290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:14.705327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:14.706291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 368/759] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:12:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:14.711791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308862c-26ef-4ac2-9e8f-b28f5fa1a42e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:14.742035 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 392/760] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:14 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:14.826227 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308862c-26ef-4ac2-9e8f-b28f5fa1a42e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:14.828646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:14.863899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb69f1-01e1-4f47-b29d-f0b63ec08c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:14.864570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb69f1-01e1-4f47-b29d-f0b63ec08c92 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:14.864860 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb69f1-01e1-4f47-b29d-f0b63ec08c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:14.865149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb69f1-01e1-4f47-b29d-f0b63ec08c92 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:14.865865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb69f1-01e1-4f47-b29d-f0b63ec08c92 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:14.866169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb69f1-01e1-4f47-b29d-f0b63ec08c92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:14.867715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb69f1-01e1-4f47-b29d-f0b63ec08c92 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:14.910822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 369/761] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Oct 27 01:12:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:15.029882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67828-6218-46ef-8735-b148a097373f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:15.148104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:15.152171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67828-6218-46ef-8735-b148a097373f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:15.189755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672b835-1749-4409-ab60-a9a3931ca795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:15.190327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b835-1749-4409-ab60-a9a3931ca795 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.190609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b835-1749-4409-ab60-a9a3931ca795 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.190915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672b835-1749-4409-ab60-a9a3931ca795 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.191514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672b835-1749-4409-ab60-a9a3931ca795 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:15.193017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672b835-1749-4409-ab60-a9a3931ca795 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-e672b835-1749-4409-ab60-a9a3931ca795 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:15.203099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:15.204110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:15.204934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 393/762] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:12:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:15.210214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb69f1-01e1-4f47-b29d-f0b63ec08c92 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:15.229172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2250-7e72-4b5a-9912-190688dfa57e None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.229498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2250-7e72-4b5a-9912-190688dfa57e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.229721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2250-7e72-4b5a-9912-190688dfa57e None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.231106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 394/763] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:15.236417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19037738-a293-4c96-a3cb-d47acb18e1eb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.236691 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19037738-a293-4c96-a3cb-d47acb18e1eb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.236957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19037738-a293-4c96-a3cb-d47acb18e1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.255664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-19037738-a293-4c96-a3cb-d47acb18e1eb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:15.256873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-19037738-a293-4c96-a3cb-d47acb18e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:15.316651 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb69f1-01e1-4f47-b29d-f0b63ec08c92 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:15.325666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 395/764] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:15 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:15.355865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccebeb-269b-4a4c-9b51-2b4fa0d9a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:15.356776 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccebeb-269b-4a4c-9b51-2b4fa0d9a62a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.357235 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccebeb-269b-4a4c-9b51-2b4fa0d9a62a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.357738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccebeb-269b-4a4c-9b51-2b4fa0d9a62a None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.358583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccebeb-269b-4a4c-9b51-2b4fa0d9a62a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:15.359082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccebeb-269b-4a4c-9b51-2b4fa0d9a62a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:15.360715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccebeb-269b-4a4c-9b51-2b4fa0d9a62a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:15.366138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 370/765] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:12:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:15.371785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19037738-a293-4c96-a3cb-d47acb18e1eb None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:15.468977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:15.478762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19037738-a293-4c96-a3cb-d47acb18e1eb None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:15.513228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452d1a-a271-4fa8-a853-45cdfba2ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:15.513851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452d1a-a271-4fa8-a853-45cdfba2ffad None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.514128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452d1a-a271-4fa8-a853-45cdfba2ffad None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.514398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452d1a-a271-4fa8-a853-45cdfba2ffad None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.515080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452d1a-a271-4fa8-a853-45cdfba2ffad None admin] RBAC: Adding query filter params (type=compute) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:15.515387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452d1a-a271-4fa8-a853-45cdfba2ffad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:15.516759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452d1a-a271-4fa8-a853-45cdfba2ffad None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:15.521807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 396/766] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:12:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:15.527652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccebeb-269b-4a4c-9b51-2b4fa0d9a62a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:15.556241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:15.586454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452d1a-a271-4fa8-a853-45cdfba2ffad None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:15.637529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccebeb-269b-4a4c-9b51-2b4fa0d9a62a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:15.674766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640c3ff-8d96-4e4f-bf60-5e23158c35c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:15.675375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640c3ff-8d96-4e4f-bf60-5e23158c35c6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.675648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640c3ff-8d96-4e4f-bf60-5e23158c35c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.675914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640c3ff-8d96-4e4f-bf60-5e23158c35c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.676617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640c3ff-8d96-4e4f-bf60-5e23158c35c6 None admin] RBAC: Adding query filter params (interface=public, service_id=79c54e8966424a388c2ea11721064b86, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:15.676943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640c3ff-8d96-4e4f-bf60-5e23158c35c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:15.678280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640c3ff-8d96-4e4f-bf60-5e23158c35c6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:15.688169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 371/767] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Oct 27 01:12:15 2022] GET /identity/v3/endpoints?service_id=79c54e8966424a388c2ea11721064b86&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:15.689510 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640c3ff-8d96-4e4f-bf60-5e23158c35c6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:15.696327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452d1a-a271-4fa8-a853-45cdfba2ffad None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:15.734769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818fd0b-eb50-4c3a-b6d3-68ac63f27e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:15.735321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818fd0b-eb50-4c3a-b6d3-68ac63f27e1d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.735603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818fd0b-eb50-4c3a-b6d3-68ac63f27e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.735881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818fd0b-eb50-4c3a-b6d3-68ac63f27e1d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.736473 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818fd0b-eb50-4c3a-b6d3-68ac63f27e1d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:15.737835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818fd0b-eb50-4c3a-b6d3-68ac63f27e1d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c818fd0b-eb50-4c3a-b6d3-68ac63f27e1d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:15.746883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:15.747895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:15.748740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 397/768] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Oct 27 01:12:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:12:15.754079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818fd0b-eb50-4c3a-b6d3-68ac63f27e1d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:15.778432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:15.785081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:15.796339 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640c3ff-8d96-4e4f-bf60-5e23158c35c6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:15.836930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f964ae1-0cc7-46f8-832e-6839d11e8b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:15.837702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f964ae1-0cc7-46f8-832e-6839d11e8b44 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.837816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f964ae1-0cc7-46f8-832e-6839d11e8b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.838092 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f964ae1-0cc7-46f8-832e-6839d11e8b44 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.838770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f964ae1-0cc7-46f8-832e-6839d11e8b44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:15.842897 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f964ae1-0cc7-46f8-832e-6839d11e8b44 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:15.851211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 372/769] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Oct 27 01:12:15 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:12:15.863954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818fd0b-eb50-4c3a-b6d3-68ac63f27e1d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:15.904384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc204-6b0b-4cd0-b7ca-34fe27ffc210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:15.905023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc204-6b0b-4cd0-b7ca-34fe27ffc210 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.905305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc204-6b0b-4cd0-b7ca-34fe27ffc210 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.905562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc204-6b0b-4cd0-b7ca-34fe27ffc210 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.906227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abc204-6b0b-4cd0-b7ca-34fe27ffc210 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:15.906525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abc204-6b0b-4cd0-b7ca-34fe27ffc210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:15.907990 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abc204-6b0b-4cd0-b7ca-34fe27ffc210 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:15.918986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 398/770] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:12:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:15.920345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f964ae1-0cc7-46f8-832e-6839d11e8b44 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:16.033696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f964ae1-0cc7-46f8-832e-6839d11e8b44 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:16.068045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50188193-69d2-4938-9e50-99e593693d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:16.068662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50188193-69d2-4938-9e50-99e593693d49 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:16.068937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50188193-69d2-4938-9e50-99e593693d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:16.069206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50188193-69d2-4938-9e50-99e593693d49 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:16.069839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50188193-69d2-4938-9e50-99e593693d49 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:16.070138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50188193-69d2-4938-9e50-99e593693d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:16.071551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50188193-69d2-4938-9e50-99e593693d49 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:16.076813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 373/771] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Oct 27 01:12:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:16.082895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc204-6b0b-4cd0-b7ca-34fe27ffc210 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:16.173578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:16.191653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc204-6b0b-4cd0-b7ca-34fe27ffc210 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:16.228806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee0e43-bfb4-4b95-b7a6-8bbbd08fc848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:16.229457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee0e43-bfb4-4b95-b7a6-8bbbd08fc848 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:16.229735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee0e43-bfb4-4b95-b7a6-8bbbd08fc848 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:16.230009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee0e43-bfb4-4b95-b7a6-8bbbd08fc848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:16.230753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee0e43-bfb4-4b95-b7a6-8bbbd08fc848 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:16.232171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee0e43-bfb4-4b95-b7a6-8bbbd08fc848 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:16.256714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 399/772] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:12:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:16.348772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c85c59-5361-4822-9f8c-e68f72f92647 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:16.348966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c85c59-5361-4822-9f8c-e68f72f92647 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:16.349186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c85c59-5361-4822-9f8c-e68f72f92647 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:16.350878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 374/773] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:16.356666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda1a41-9777-49cc-8577-47a3a39184fd None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:16.356982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda1a41-9777-49cc-8577-47a3a39184fd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:16.357224 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda1a41-9777-49cc-8577-47a3a39184fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:16.377510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2bda1a41-9777-49cc-8577-47a3a39184fd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:16.378757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2bda1a41-9777-49cc-8577-47a3a39184fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:16.460838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 400/774] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:16.720972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c85c59-5361-4822-9f8c-e68f72f92647 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:16.741156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:16.832013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c85c59-5361-4822-9f8c-e68f72f92647 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:16.868890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f82d51-2fea-4828-87c3-af7f137096b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:16.869525 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f82d51-2fea-4828-87c3-af7f137096b7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:16.869813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f82d51-2fea-4828-87c3-af7f137096b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:16.870076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f82d51-2fea-4828-87c3-af7f137096b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:16.870664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f82d51-2fea-4828-87c3-af7f137096b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:16.872046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f82d51-2fea-4828-87c3-af7f137096b7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-60f82d51-2fea-4828-87c3-af7f137096b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:16.880904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:16.881854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:12:16.882677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:16.887151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 375/775] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Oct 27 01:12:16 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:16.888369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda1a41-9777-49cc-8577-47a3a39184fd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:16.955742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:16.988608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda1a41-9777-49cc-8577-47a3a39184fd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:17.022482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6504a-3de3-4718-b0a2-58b1f0fdd244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:17.023142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6504a-3de3-4718-b0a2-58b1f0fdd244 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:17.023417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6504a-3de3-4718-b0a2-58b1f0fdd244 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:17.023719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6504a-3de3-4718-b0a2-58b1f0fdd244 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:17.024353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6504a-3de3-4718-b0a2-58b1f0fdd244 None admin] RBAC: Adding query filter params (name=image) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:17.024650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6504a-3de3-4718-b0a2-58b1f0fdd244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:17.026006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6504a-3de3-4718-b0a2-58b1f0fdd244 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:17.031040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 401/776] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:17.036618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f82d51-2fea-4828-87c3-af7f137096b7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:17.121218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:17.142345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f82d51-2fea-4828-87c3-af7f137096b7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:17.179272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530a265-1cd5-4d7a-a4e1-76bd4c87edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:17.179901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530a265-1cd5-4d7a-a4e1-76bd4c87edf6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:17.180178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530a265-1cd5-4d7a-a4e1-76bd4c87edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:17.180451 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530a265-1cd5-4d7a-a4e1-76bd4c87edf6 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:17.181077 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530a265-1cd5-4d7a-a4e1-76bd4c87edf6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:17.181379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530a265-1cd5-4d7a-a4e1-76bd4c87edf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:17.182750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530a265-1cd5-4d7a-a4e1-76bd4c87edf6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:17.187885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 376/777] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:17.193497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6504a-3de3-4718-b0a2-58b1f0fdd244 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:17.290651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6504a-3de3-4718-b0a2-58b1f0fdd244 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:17.323337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c65d50-3212-4bdb-bf1d-8c3e5115e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:17.323951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c65d50-3212-4bdb-bf1d-8c3e5115e8f4 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:17.324229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c65d50-3212-4bdb-bf1d-8c3e5115e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:17.324497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c65d50-3212-4bdb-bf1d-8c3e5115e8f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:17.325171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c65d50-3212-4bdb-bf1d-8c3e5115e8f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:17.326534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c65d50-3212-4bdb-bf1d-8c3e5115e8f4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:17.331075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:17.348661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 402/778] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:12:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:18.011072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028161f-8d99-4a1a-90ad-734daf20b639 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:18.011614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028161f-8d99-4a1a-90ad-734daf20b639 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:18.011614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028161f-8d99-4a1a-90ad-734daf20b639 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:18.013297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 377/779] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:18.018927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20441a-b909-44a8-b563-d1827aef8d1c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:18.019347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20441a-b909-44a8-b563-d1827aef8d1c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:18.019485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20441a-b909-44a8-b563-d1827aef8d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:18.039074 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-db20441a-b909-44a8-b563-d1827aef8d1c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:18.040499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-db20441a-b909-44a8-b563-d1827aef8d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:18.118628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 403/780] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:18 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:18.389963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028161f-8d99-4a1a-90ad-734daf20b639 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:18.390951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a844cb-319c-4935-9b80-b6d726ca65dd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:18.391239 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a844cb-319c-4935-9b80-b6d726ca65dd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:18.391513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a844cb-319c-4935-9b80-b6d726ca65dd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:18.392961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 404/781] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:18.397735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2b1f3-7612-411c-97f9-b65631f67eca None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:18.398017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2b1f3-7612-411c-97f9-b65631f67eca None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:18.398289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2b1f3-7612-411c-97f9-b65631f67eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:18.415873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0cc2b1f3-7612-411c-97f9-b65631f67eca None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:18.417052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0cc2b1f3-7612-411c-97f9-b65631f67eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:18.493791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 405/782] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:18 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:18.503327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028161f-8d99-4a1a-90ad-734daf20b639 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:18.537577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72259df3-d3f8-40af-b998-6804f74d285e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:18.538208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72259df3-d3f8-40af-b998-6804f74d285e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:18.538484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72259df3-d3f8-40af-b998-6804f74d285e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:18.538782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72259df3-d3f8-40af-b998-6804f74d285e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:18.539418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72259df3-d3f8-40af-b998-6804f74d285e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:18.540787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72259df3-d3f8-40af-b998-6804f74d285e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-72259df3-d3f8-40af-b998-6804f74d285e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:18.549611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:18.550594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:12:18.551762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:18.555192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 378/783] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:12:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:18.557261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2b1f3-7612-411c-97f9-b65631f67eca None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:18.603376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:18.656419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2b1f3-7612-411c-97f9-b65631f67eca None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:18.689412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43013732-50fb-4f17-988f-9c78d8e2f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:18.690062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43013732-50fb-4f17-988f-9c78d8e2f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:18.690340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43013732-50fb-4f17-988f-9c78d8e2f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:18.690592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43013732-50fb-4f17-988f-9c78d8e2f9e8 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:18.691272 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43013732-50fb-4f17-988f-9c78d8e2f9e8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:18.691578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43013732-50fb-4f17-988f-9c78d8e2f9e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:18.692936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43013732-50fb-4f17-988f-9c78d8e2f9e8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:18.697948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 406/784] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:12:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:18.703562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72259df3-d3f8-40af-b998-6804f74d285e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:18.716682 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:18.782510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43013732-50fb-4f17-988f-9c78d8e2f9e8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:18.806086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72259df3-d3f8-40af-b998-6804f74d285e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:18.841987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94aa9-6350-46cc-81c7-8ebf71913ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:18.842605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94aa9-6350-46cc-81c7-8ebf71913ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:18.842914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94aa9-6350-46cc-81c7-8ebf71913ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:18.843194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94aa9-6350-46cc-81c7-8ebf71913ae0 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:18.843804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94aa9-6350-46cc-81c7-8ebf71913ae0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:18.844109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94aa9-6350-46cc-81c7-8ebf71913ae0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:18.845478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94aa9-6350-46cc-81c7-8ebf71913ae0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:18.855352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 379/785] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Oct 27 01:12:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:18.855977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94aa9-6350-46cc-81c7-8ebf71913ae0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:18.895632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43013732-50fb-4f17-988f-9c78d8e2f9e8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:18.907424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:18.930664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:18.934089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31862652-13e3-47d4-8e64-6f94ae50bbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:18.934755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31862652-13e3-47d4-8e64-6f94ae50bbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:18.935353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31862652-13e3-47d4-8e64-6f94ae50bbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:18.935628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31862652-13e3-47d4-8e64-6f94ae50bbb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:18.936894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31862652-13e3-47d4-8e64-6f94ae50bbb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:18.938320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31862652-13e3-47d4-8e64-6f94ae50bbb4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:18.939926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 407/786] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:18.945675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31862652-13e3-47d4-8e64-6f94ae50bbb4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:18.960750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94aa9-6350-46cc-81c7-8ebf71913ae0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:18.995849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70e2b3-64b9-4eb9-b5a4-608514fc780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:18.996474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e2b3-64b9-4eb9-b5a4-608514fc780a None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:18.996744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e2b3-64b9-4eb9-b5a4-608514fc780a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:18.997013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e2b3-64b9-4eb9-b5a4-608514fc780a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:18.997688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70e2b3-64b9-4eb9-b5a4-608514fc780a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:18.999088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70e2b3-64b9-4eb9-b5a4-608514fc780a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:19.021248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 380/787] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:12:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:19.065662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31862652-13e3-47d4-8e64-6f94ae50bbb4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:19.112174 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdb395-8d70-4261-91c8-61779c116130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:19.113215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb395-8d70-4261-91c8-61779c116130 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:19.113683 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb395-8d70-4261-91c8-61779c116130 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:19.114159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb395-8d70-4261-91c8-61779c116130 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:19.115094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdb395-8d70-4261-91c8-61779c116130 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:19.116740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdb395-8d70-4261-91c8-61779c116130 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:19.154781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 408/788] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:12:18 2022] POST /identity/v3/projects => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:19.514643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec519-a8c6-41a5-8416-d9875cf208af None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:19.514928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec519-a8c6-41a5-8416-d9875cf208af None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:19.515213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec519-a8c6-41a5-8416-d9875cf208af None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:19.516740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 381/789] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:19.521947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f9189-4e2e-443c-85c4-d9e78b4b84a3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:19.522244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f9189-4e2e-443c-85c4-d9e78b4b84a3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:19.522530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f9189-4e2e-443c-85c4-d9e78b4b84a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:19.540960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-dc0f9189-4e2e-443c-85c4-d9e78b4b84a3 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:19.542157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dc0f9189-4e2e-443c-85c4-d9e78b4b84a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:19.562352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:19.614754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 409/790] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:19.874289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ec519-a8c6-41a5-8416-d9875cf208af None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:19.980025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ec519-a8c6-41a5-8416-d9875cf208af None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:20.012141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:20.020112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:20.020714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:20.020999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:20.021640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:20.022327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:20.023997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:20.032275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.sql.core [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 01:12:20.032275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 01:12:20.032275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [parameters: {'id': 'c9b4fb6a5183496c9f332b802908840f', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 01:12:20.032275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81615) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:12:20.040153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 01:12:20.040931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application yield resource Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise self.value Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application session.commit() Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 01:12:20.041885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.flush() Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application compat.raise_( Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 01:12:20.043301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 01:12:20.044188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 01:12:20.044959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [parameters: {'id': 'c9b4fb6a5183496c9f332b802908840f', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 01:12:20.045813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:20.046577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:20.049115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 382/791] 10.222.0.23 () {60 vars in 1137 bytes} [Thu Oct 27 01:12:19 2022] POST /identity/v3/domains => generated 190 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:20.050695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f9189-4e2e-443c-85c4-d9e78b4b84a3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:20.153180 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f9189-4e2e-443c-85c4-d9e78b4b84a3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:20.187355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c8205-b1ae-4dc5-9970-69132b10961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:20.187990 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c8205-b1ae-4dc5-9970-69132b10961e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:20.188267 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c8205-b1ae-4dc5-9970-69132b10961e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:20.188592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c8205-b1ae-4dc5-9970-69132b10961e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:20.199038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c8205-b1ae-4dc5-9970-69132b10961e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:20.200470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c8205-b1ae-4dc5-9970-69132b10961e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-167c8205-b1ae-4dc5-9970-69132b10961e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:12:20.214876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:20.215886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:12:20.216792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:12:20.216792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:20.216792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:20.222124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:20.224964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 410/792] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:12:20.325993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d22e0-98fa-45eb-b173-fc4e6bbe793a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:20.360323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef99ef-d0c7-4751-94ba-67da6961283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:20.360996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef99ef-d0c7-4751-94ba-67da6961283d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:20.361279 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef99ef-d0c7-4751-94ba-67da6961283d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:20.361552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef99ef-d0c7-4751-94ba-67da6961283d None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:20.362199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef99ef-d0c7-4751-94ba-67da6961283d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:20.362498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef99ef-d0c7-4751-94ba-67da6961283d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:20.363988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef99ef-d0c7-4751-94ba-67da6961283d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:20.382759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 383/793] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:21.270233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a6e-8fe5-4673-9c67-7e27d73d1508 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:21.270818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a6e-8fe5-4673-9c67-7e27d73d1508 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:21.270818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a6e-8fe5-4673-9c67-7e27d73d1508 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:21.272202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 411/794] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:21.277715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2165-b00a-4929-a26c-9b024aea49b2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:21.278174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2165-b00a-4929-a26c-9b024aea49b2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:21.278274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2165-b00a-4929-a26c-9b024aea49b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:21.297063 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-703b2165-b00a-4929-a26c-9b024aea49b2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:21.298242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-703b2165-b00a-4929-a26c-9b024aea49b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:21.312491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667242f6-ed94-4bc6-baec-6d1de0a372f7 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:21.312747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667242f6-ed94-4bc6-baec-6d1de0a372f7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:21.313013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667242f6-ed94-4bc6-baec-6d1de0a372f7 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:21.314481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 412/795] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:21.319302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615fada-8e7b-4214-8ddc-98a9858580e3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:21.319578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615fada-8e7b-4214-8ddc-98a9858580e3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:21.319853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615fada-8e7b-4214-8ddc-98a9858580e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:21.338461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3615fada-8e7b-4214-8ddc-98a9858580e3 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:21.339659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3615fada-8e7b-4214-8ddc-98a9858580e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:21.341618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:21.350490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:21.369945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 384/796] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:21.407056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 413/797] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:12:21.638191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2165-b00a-4929-a26c-9b024aea49b2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:21.666164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615fada-8e7b-4214-8ddc-98a9858580e3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:21.739057 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2165-b00a-4929-a26c-9b024aea49b2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:21.762252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615fada-8e7b-4214-8ddc-98a9858580e3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:21.772360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abe2fd-ef5c-4a06-a1b1-1fb491990b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:21.772994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe2fd-ef5c-4a06-a1b1-1fb491990b74 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:21.773273 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe2fd-ef5c-4a06-a1b1-1fb491990b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:21.773595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe2fd-ef5c-4a06-a1b1-1fb491990b74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:21.783926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abe2fd-ef5c-4a06-a1b1-1fb491990b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-79abe2fd-ef5c-4a06-a1b1-1fb491990b74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:12:21.788781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:21.789755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:21.790609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 385/798] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Oct 27 01:12:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:21.796096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abe2fd-ef5c-4a06-a1b1-1fb491990b74 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:21.797443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762c5f3-fdc7-4e8d-8942-6b8f85406284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:21.798087 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762c5f3-fdc7-4e8d-8942-6b8f85406284 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:21.798362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762c5f3-fdc7-4e8d-8942-6b8f85406284 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:21.798632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762c5f3-fdc7-4e8d-8942-6b8f85406284 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:21.799764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762c5f3-fdc7-4e8d-8942-6b8f85406284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:21.801186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762c5f3-fdc7-4e8d-8942-6b8f85406284 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:21.802760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 414/799] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:21.808222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762c5f3-fdc7-4e8d-8942-6b8f85406284 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:21.816540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:21.843217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:21.896182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abe2fd-ef5c-4a06-a1b1-1fb491990b74 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:21.908832 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762c5f3-fdc7-4e8d-8942-6b8f85406284 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:21.931504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563a176-c1d9-4bda-b327-f4365bc2d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:21.932122 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563a176-c1d9-4bda-b327-f4365bc2d423 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:21.932404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563a176-c1d9-4bda-b327-f4365bc2d423 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:21.932702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563a176-c1d9-4bda-b327-f4365bc2d423 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:21.933366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563a176-c1d9-4bda-b327-f4365bc2d423 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:21.933662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563a176-c1d9-4bda-b327-f4365bc2d423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:21.935098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563a176-c1d9-4bda-b327-f4365bc2d423 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:21.942255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3175b-ce89-49fe-b50f-59bb0e027ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:21.942902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3175b-ce89-49fe-b50f-59bb0e027ba6 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:21.943024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 386/800] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Oct 27 01:12:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:21.943179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3175b-ce89-49fe-b50f-59bb0e027ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:21.943528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3175b-ce89-49fe-b50f-59bb0e027ba6 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:21.944263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3175b-ce89-49fe-b50f-59bb0e027ba6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:21.945692 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3175b-ce89-49fe-b50f-59bb0e027ba6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:21.948828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563a176-c1d9-4bda-b327-f4365bc2d423 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:21.967986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 415/801] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:12:21 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:12:22.060101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563a176-c1d9-4bda-b327-f4365bc2d423 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:22.067990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:22.096913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196adca-c11a-4a65-bff1-d9e8cbd30223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:22.097581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196adca-c11a-4a65-bff1-d9e8cbd30223 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:22.097843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196adca-c11a-4a65-bff1-d9e8cbd30223 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:22.098110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196adca-c11a-4a65-bff1-d9e8cbd30223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:22.109976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196adca-c11a-4a65-bff1-d9e8cbd30223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:22.111472 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196adca-c11a-4a65-bff1-d9e8cbd30223 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5196adca-c11a-4a65-bff1-d9e8cbd30223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:12:22.126875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:22.127876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:12:22.128771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:12:22.128771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:22.128771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:22.128771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 387/802] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:12:22.134225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3175b-ce89-49fe-b50f-59bb0e027ba6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:22.202543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:22.241774 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3175b-ce89-49fe-b50f-59bb0e027ba6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:22.275169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d48f-e5af-43f8-882c-f2076faf9717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:22.275779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d48f-e5af-43f8-882c-f2076faf9717 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:22.276051 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d48f-e5af-43f8-882c-f2076faf9717 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:22.276320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d48f-e5af-43f8-882c-f2076faf9717 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:22.276967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d48f-e5af-43f8-882c-f2076faf9717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:22.277247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d48f-e5af-43f8-882c-f2076faf9717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:22.278623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d48f-e5af-43f8-882c-f2076faf9717 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:22.290468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 416/803] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:22.296345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196adca-c11a-4a65-bff1-d9e8cbd30223 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:22.401627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196adca-c11a-4a65-bff1-d9e8cbd30223 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:22.436392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0917a3-1730-42a9-a27f-12b3f07b997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:22.437017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0917a3-1730-42a9-a27f-12b3f07b997a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:22.437291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0917a3-1730-42a9-a27f-12b3f07b997a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:22.437545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0917a3-1730-42a9-a27f-12b3f07b997a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:22.445203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0917a3-1730-42a9-a27f-12b3f07b997a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:22.446703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0917a3-1730-42a9-a27f-12b3f07b997a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7c0917a3-1730-42a9-a27f-12b3f07b997a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:12:22.457931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:22.459013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:22.459933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 388/804] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Oct 27 01:12:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:22.465011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d48f-e5af-43f8-882c-f2076faf9717 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:22.570071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d48f-e5af-43f8-882c-f2076faf9717 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:22.592640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:22.605020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b264-f471-4152-a185-b68db7307a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:22.605633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b264-f471-4152-a185-b68db7307a34 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:22.605897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b264-f471-4152-a185-b68db7307a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:22.606169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b264-f471-4152-a185-b68db7307a34 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:22.606919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2b264-f471-4152-a185-b68db7307a34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:22.607218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2b264-f471-4152-a185-b68db7307a34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:22.608629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2b264-f471-4152-a185-b68db7307a34 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:22.625840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 417/805] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Oct 27 01:12:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:22.631783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0917a3-1730-42a9-a27f-12b3f07b997a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:22.652247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:22.735138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0917a3-1730-42a9-a27f-12b3f07b997a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:22.770065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbb868-9b8b-4647-90bd-c3f9c17013f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:22.770696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbb868-9b8b-4647-90bd-c3f9c17013f5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:22.770993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbb868-9b8b-4647-90bd-c3f9c17013f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:22.771266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbb868-9b8b-4647-90bd-c3f9c17013f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:22.782113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbb868-9b8b-4647-90bd-c3f9c17013f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:22.783598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbb868-9b8b-4647-90bd-c3f9c17013f5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c7bbb868-9b8b-4647-90bd-c3f9c17013f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:12:22.797641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:22.798603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:12:22.799551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:12:22.799551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:22.799551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:22.799551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 389/806] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:22.804569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b264-f471-4152-a185-b68db7307a34 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:22.915236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b264-f471-4152-a185-b68db7307a34 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:22.949606 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571a239-69db-445e-9361-63dcccaa3141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:22.950210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a239-69db-445e-9361-63dcccaa3141 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:22.950493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a239-69db-445e-9361-63dcccaa3141 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:22.950785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a239-69db-445e-9361-63dcccaa3141 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:22.951425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571a239-69db-445e-9361-63dcccaa3141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:22.951728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571a239-69db-445e-9361-63dcccaa3141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:22.953085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571a239-69db-445e-9361-63dcccaa3141 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:22.964155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 418/807] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:22.970117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbb868-9b8b-4647-90bd-c3f9c17013f5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:23.045023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:23.077408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbb868-9b8b-4647-90bd-c3f9c17013f5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:23.112085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96974a2b-a2fc-4967-ba1b-1a546fad5a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:23.112713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96974a2b-a2fc-4967-ba1b-1a546fad5a24 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.113001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96974a2b-a2fc-4967-ba1b-1a546fad5a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.113248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96974a2b-a2fc-4967-ba1b-1a546fad5a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.120258 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96974a2b-a2fc-4967-ba1b-1a546fad5a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:23.121687 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96974a2b-a2fc-4967-ba1b-1a546fad5a24 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-96974a2b-a2fc-4967-ba1b-1a546fad5a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:12:23.133260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:23.134225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:23.135204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:12:23.135204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:12:23.135204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:12:23.135204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:12:23.135204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:12:23.135204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:12:23.135204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:12:23.135204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:23.135204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 390/808] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:23.140748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571a239-69db-445e-9361-63dcccaa3141 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:23.183167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:23.240155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571a239-69db-445e-9361-63dcccaa3141 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:23.273463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764032a-c6bb-4ff1-8c00-e69a4d5482ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:23.274122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764032a-c6bb-4ff1-8c00-e69a4d5482ad None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.274401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764032a-c6bb-4ff1-8c00-e69a4d5482ad None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.274672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764032a-c6bb-4ff1-8c00-e69a4d5482ad None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.275396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764032a-c6bb-4ff1-8c00-e69a4d5482ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:23.275958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764032a-c6bb-4ff1-8c00-e69a4d5482ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:23.277120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764032a-c6bb-4ff1-8c00-e69a4d5482ad None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:23.289679 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 419/809] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:23.296030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96974a2b-a2fc-4967-ba1b-1a546fad5a24 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:23.402220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96974a2b-a2fc-4967-ba1b-1a546fad5a24 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:23.429358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:23.436655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25013853-7337-49ce-ae4a-2402f0f9d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:23.437326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25013853-7337-49ce-ae4a-2402f0f9d1a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.437605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25013853-7337-49ce-ae4a-2402f0f9d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.437879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25013853-7337-49ce-ae4a-2402f0f9d1a0 None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/8af81f74f98b478ab71c0b22b365e3da/roles/2543068f563f4327a495ba5e5d4a430a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.440257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25013853-7337-49ce-ae4a-2402f0f9d1a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=8af81f74f98b478ab71c0b22b365e3da, role_id=2543068f563f4327a495ba5e5d4a430a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:23.441730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25013853-7337-49ce-ae4a-2402f0f9d1a0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:23.454801 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 391/810] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:12:23 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/8af81f74f98b478ab71c0b22b365e3da/roles/2543068f563f4327a495ba5e5d4a430a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:12:24.141474 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2197e14-b2c6-412a-83d4-bfa5d0239266 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:24.141690 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2197e14-b2c6-412a-83d4-bfa5d0239266 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:24.141901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2197e14-b2c6-412a-83d4-bfa5d0239266 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:24.143337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 420/811] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:24.148971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43513a6-6f6a-4b70-a6e9-8910f3fb287e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:24.149261 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43513a6-6f6a-4b70-a6e9-8910f3fb287e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:24.149534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43513a6-6f6a-4b70-a6e9-8910f3fb287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:24.168495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d43513a6-6f6a-4b70-a6e9-8910f3fb287e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:24.169708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d43513a6-6f6a-4b70-a6e9-8910f3fb287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:24.238377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 392/812] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:24.501071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2197e14-b2c6-412a-83d4-bfa5d0239266 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:24.604567 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:24.609609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2197e14-b2c6-412a-83d4-bfa5d0239266 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:24.645637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfefa9-b55a-4400-8014-0971830a4e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:24.646281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfefa9-b55a-4400-8014-0971830a4e37 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:24.646561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfefa9-b55a-4400-8014-0971830a4e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:24.646866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfefa9-b55a-4400-8014-0971830a4e37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:24.657456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfefa9-b55a-4400-8014-0971830a4e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a3cfefa9-b55a-4400-8014-0971830a4e37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:12:24.662266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:24.663227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:12:24.664116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:24.666862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 421/813] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:12:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:24.669503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43513a6-6f6a-4b70-a6e9-8910f3fb287e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:24.771160 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43513a6-6f6a-4b70-a6e9-8910f3fb287e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:24.791406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:24.807465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4539658-ea89-40cc-9610-4ebd41a44409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:24.808085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539658-ea89-40cc-9610-4ebd41a44409 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:24.808368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539658-ea89-40cc-9610-4ebd41a44409 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:24.808639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539658-ea89-40cc-9610-4ebd41a44409 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:24.809314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4539658-ea89-40cc-9610-4ebd41a44409 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:24.809617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4539658-ea89-40cc-9610-4ebd41a44409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:24.811015 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4539658-ea89-40cc-9610-4ebd41a44409 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:24.819168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 393/814] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:24.825236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfefa9-b55a-4400-8014-0971830a4e37 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:24.926843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfefa9-b55a-4400-8014-0971830a4e37 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:24.960688 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d753f-9137-4cf9-8a3a-ad5f21f1918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:24.961361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d753f-9137-4cf9-8a3a-ad5f21f1918b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:24.961636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d753f-9137-4cf9-8a3a-ad5f21f1918b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:24.961903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d753f-9137-4cf9-8a3a-ad5f21f1918b None admin] PATH_INFO: `/v3/users/27207f91b35142bfa921d52970dfccf9` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:24.975297 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d753f-9137-4cf9-8a3a-ad5f21f1918b None admin] RBAC: Authorizing `identity:get_user(user_id=27207f91b35142bfa921d52970dfccf9)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:24.976742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d753f-9137-4cf9-8a3a-ad5f21f1918b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:24.978355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 422/815] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:12:24 2022] GET /identity/v3/users/27207f91b35142bfa921d52970dfccf9 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:24.984256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4539658-ea89-40cc-9610-4ebd41a44409 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:25.087395 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4539658-ea89-40cc-9610-4ebd41a44409 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:25.121908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce5ec5-6b74-4ce5-869c-18b9e89bf66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:25.122533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce5ec5-6b74-4ce5-869c-18b9e89bf66c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:25.122841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce5ec5-6b74-4ce5-869c-18b9e89bf66c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:25.123107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce5ec5-6b74-4ce5-869c-18b9e89bf66c None admin] PATH_INFO: `/v3/projects/5c38020e60104fb69bee381d85ee57f3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:25.124252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce5ec5-6b74-4ce5-869c-18b9e89bf66c None admin] RBAC: Authorizing `identity:get_project(project_id=5c38020e60104fb69bee381d85ee57f3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:25.125678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce5ec5-6b74-4ce5-869c-18b9e89bf66c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:25.127563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 394/816] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:12:24 2022] GET /identity/v3/projects/5c38020e60104fb69bee381d85ee57f3 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:25.133393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d753f-9137-4cf9-8a3a-ad5f21f1918b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:25.153251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:25.233677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d753f-9137-4cf9-8a3a-ad5f21f1918b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:25.268170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b6a52-e87e-4938-bcc9-e12f0c01cf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:25.268822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b6a52-e87e-4938-bcc9-e12f0c01cf08 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:25.269100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b6a52-e87e-4938-bcc9-e12f0c01cf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:25.269369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b6a52-e87e-4938-bcc9-e12f0c01cf08 None admin] PATH_INFO: `/v3/projects/5c38020e60104fb69bee381d85ee57f3/users/27207f91b35142bfa921d52970dfccf9/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:25.271326 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b6a52-e87e-4938-bcc9-e12f0c01cf08 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c38020e60104fb69bee381d85ee57f3, user_id=27207f91b35142bfa921d52970dfccf9, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:25.272743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b6a52-e87e-4938-bcc9-e12f0c01cf08 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:25.286868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 423/817] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:12:25 2022] PUT /identity/v3/projects/5c38020e60104fb69bee381d85ee57f3/users/27207f91b35142bfa921d52970dfccf9/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:12:25.583044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c5098-59e2-4811-a168-46529256345a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:25.583307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c5098-59e2-4811-a168-46529256345a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:25.583559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c5098-59e2-4811-a168-46529256345a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:25.584944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 395/818] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:25.590393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5061586-cd84-408c-9a3f-24b4f234d0e0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:25.590907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5061586-cd84-408c-9a3f-24b4f234d0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:25.591007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5061586-cd84-408c-9a3f-24b4f234d0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:25.609492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d5061586-cd84-408c-9a3f-24b4f234d0e0 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:25.610679 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d5061586-cd84-408c-9a3f-24b4f234d0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:25.678556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 424/819] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:25.941727 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c5098-59e2-4811-a168-46529256345a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:25.993751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:26.047039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c5098-59e2-4811-a168-46529256345a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:26.081292 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e117c-3725-4868-ad30-bc1707be41cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:26.081919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e117c-3725-4868-ad30-bc1707be41cd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:26.082193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e117c-3725-4868-ad30-bc1707be41cd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:26.082464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e117c-3725-4868-ad30-bc1707be41cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:26.093043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e117c-3725-4868-ad30-bc1707be41cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7c2e117c-3725-4868-ad30-bc1707be41cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:12:26.097868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:26.098840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:26.099706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 396/820] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Oct 27 01:12:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:26.105165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5061586-cd84-408c-9a3f-24b4f234d0e0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:26.115436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:26.215181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5061586-cd84-408c-9a3f-24b4f234d0e0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:26.249728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53497097-2b21-46e7-9bd0-0ebcbda24087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:26.250333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497097-2b21-46e7-9bd0-0ebcbda24087 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:26.250609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497097-2b21-46e7-9bd0-0ebcbda24087 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:26.250905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497097-2b21-46e7-9bd0-0ebcbda24087 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:26.251583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53497097-2b21-46e7-9bd0-0ebcbda24087 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:26.251885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53497097-2b21-46e7-9bd0-0ebcbda24087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:26.253251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53497097-2b21-46e7-9bd0-0ebcbda24087 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:26.261398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 425/821] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Oct 27 01:12:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:26.267822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e117c-3725-4868-ad30-bc1707be41cd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:26.372691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e117c-3725-4868-ad30-bc1707be41cd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:26.382974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:26.408871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f316-bcf6-401a-bf6c-e3d2be5baa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:26.409507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f316-bcf6-401a-bf6c-e3d2be5baa55 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:26.409788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f316-bcf6-401a-bf6c-e3d2be5baa55 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:26.410065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f316-bcf6-401a-bf6c-e3d2be5baa55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:26.420583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f316-bcf6-401a-bf6c-e3d2be5baa55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:26.422030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f316-bcf6-401a-bf6c-e3d2be5baa55 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-bd37f316-bcf6-401a-bf6c-e3d2be5baa55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:12:26.436410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:26.437536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:12:26.438857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:12:26.438857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:26.438857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:26.438857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 397/822] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:26.443426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53497097-2b21-46e7-9bd0-0ebcbda24087 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:26.514567 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:26.546605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53497097-2b21-46e7-9bd0-0ebcbda24087 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:26.580008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56461179-8068-4386-861e-4630356593e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:26.580611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56461179-8068-4386-861e-4630356593e5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:26.580884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56461179-8068-4386-861e-4630356593e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:26.581134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56461179-8068-4386-861e-4630356593e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:26.581773 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56461179-8068-4386-861e-4630356593e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:26.582072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56461179-8068-4386-861e-4630356593e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:26.583461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56461179-8068-4386-861e-4630356593e5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:26.594789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 426/823] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:26.600627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f316-bcf6-401a-bf6c-e3d2be5baa55 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:26.704354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f316-bcf6-401a-bf6c-e3d2be5baa55 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:26.738699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cc45f-dd4c-49a1-a251-c84ae7e7a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:26.739351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc45f-dd4c-49a1-a251-c84ae7e7a3bc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:26.739629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc45f-dd4c-49a1-a251-c84ae7e7a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:26.739897 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc45f-dd4c-49a1-a251-c84ae7e7a3bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:26.747289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cc45f-dd4c-49a1-a251-c84ae7e7a3bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:26.748725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cc45f-dd4c-49a1-a251-c84ae7e7a3bc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-cb8cc45f-dd4c-49a1-a251-c84ae7e7a3bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:12:26.760084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:26.761039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:26.761991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 398/824] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Oct 27 01:12:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:26.767576 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56461179-8068-4386-861e-4630356593e5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:26.873033 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56461179-8068-4386-861e-4630356593e5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:26.901883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:26.908394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051efb45-ceba-4482-8d3f-e60a9af5d7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:26.909015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051efb45-ceba-4482-8d3f-e60a9af5d7ec None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:26.909296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051efb45-ceba-4482-8d3f-e60a9af5d7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:26.909569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051efb45-ceba-4482-8d3f-e60a9af5d7ec None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:26.910300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051efb45-ceba-4482-8d3f-e60a9af5d7ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:26.910604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051efb45-ceba-4482-8d3f-e60a9af5d7ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:26.912072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051efb45-ceba-4482-8d3f-e60a9af5d7ec None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:26.929623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 427/825] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Oct 27 01:12:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:26.935547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cc45f-dd4c-49a1-a251-c84ae7e7a3bc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:26.961943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:27.040816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cc45f-dd4c-49a1-a251-c84ae7e7a3bc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:27.075143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980eb6b-6ff9-415c-88a4-401304f49d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:27.075745 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980eb6b-6ff9-415c-88a4-401304f49d94 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:27.076025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980eb6b-6ff9-415c-88a4-401304f49d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:27.076291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980eb6b-6ff9-415c-88a4-401304f49d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:27.145729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980eb6b-6ff9-415c-88a4-401304f49d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:27.147236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980eb6b-6ff9-415c-88a4-401304f49d94 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:27.170204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:27.254436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 399/826] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:12:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:27.255790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051efb45-ceba-4482-8d3f-e60a9af5d7ec None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:27.360794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051efb45-ceba-4482-8d3f-e60a9af5d7ec None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:27.363093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fe36d-3434-409b-98c4-14e65e1b66f0 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:27.363450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fe36d-3434-409b-98c4-14e65e1b66f0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:27.363791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fe36d-3434-409b-98c4-14e65e1b66f0 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:27.365159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 400/827] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:27.370403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81677-1c33-4dfb-ae32-78de8952b6cc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:27.370689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81677-1c33-4dfb-ae32-78de8952b6cc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:27.370986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81677-1c33-4dfb-ae32-78de8952b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:27.389787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-35d81677-1c33-4dfb-ae32-78de8952b6cc None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:27.391050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-35d81677-1c33-4dfb-ae32-78de8952b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:27.394347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeefeb1-52a5-46a0-9adc-d220a7f6d5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:27.395005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeefeb1-52a5-46a0-9adc-d220a7f6d5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:27.395279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeefeb1-52a5-46a0-9adc-d220a7f6d5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:27.395551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeefeb1-52a5-46a0-9adc-d220a7f6d5c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:27.405765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeefeb1-52a5-46a0-9adc-d220a7f6d5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:27.407259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeefeb1-52a5-46a0-9adc-d220a7f6d5c2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ceeefeb1-52a5-46a0-9adc-d220a7f6d5c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:12:27.422284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:27.423269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:12:27.424169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:12:27.424169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:12:27.424169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:27.424169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 428/828] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:27.429315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeefeb1-52a5-46a0-9adc-d220a7f6d5c2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:27.458340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 401/829] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:27.469396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:27.527294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeefeb1-52a5-46a0-9adc-d220a7f6d5c2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:27.559288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf11135-7ad8-40a6-b916-bf9097ba9402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:27.559891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf11135-7ad8-40a6-b916-bf9097ba9402 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:27.560164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf11135-7ad8-40a6-b916-bf9097ba9402 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:27.560432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf11135-7ad8-40a6-b916-bf9097ba9402 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:27.561075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf11135-7ad8-40a6-b916-bf9097ba9402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:27.561379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf11135-7ad8-40a6-b916-bf9097ba9402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:27.562743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf11135-7ad8-40a6-b916-bf9097ba9402 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:27.574157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 429/830] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:27.580089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81677-1c33-4dfb-ae32-78de8952b6cc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:27.636568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:27.685320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81677-1c33-4dfb-ae32-78de8952b6cc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:27.717997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf11135-7ad8-40a6-b916-bf9097ba9402 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:27.720349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbe411-443d-47ca-b5f7-7fdd0f20b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:27.721006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbe411-443d-47ca-b5f7-7fdd0f20b338 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:27.721267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbe411-443d-47ca-b5f7-7fdd0f20b338 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:27.721533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbe411-443d-47ca-b5f7-7fdd0f20b338 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:27.728581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbe411-443d-47ca-b5f7-7fdd0f20b338 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:27.730007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbe411-443d-47ca-b5f7-7fdd0f20b338 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-74cbe411-443d-47ca-b5f7-7fdd0f20b338 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:12:27.741540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:27.742509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:27.743437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:12:27.743437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:12:27.743437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:12:27.743437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:12:27.743437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:12:27.743437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:12:27.743437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:12:27.743437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:27.743437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 402/831] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:12:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:27.748500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbe411-443d-47ca-b5f7-7fdd0f20b338 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:27.815120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:27.818102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf11135-7ad8-40a6-b916-bf9097ba9402 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:27.850698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbe411-443d-47ca-b5f7-7fdd0f20b338 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:27.853882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e88076-fed7-4a22-9bb2-2349d2bb1f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:27.854522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e88076-fed7-4a22-9bb2-2349d2bb1f43 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:27.854824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e88076-fed7-4a22-9bb2-2349d2bb1f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:27.855099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e88076-fed7-4a22-9bb2-2349d2bb1f43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:27.863539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:27.865250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e88076-fed7-4a22-9bb2-2349d2bb1f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-39e88076-fed7-4a22-9bb2-2349d2bb1f43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:12:27.870427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:27.871552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:27.872547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 430/832] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:27.877522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e88076-fed7-4a22-9bb2-2349d2bb1f43 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:27.887468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66ef93-72fe-425d-95fd-5d2795788f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:27.888450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66ef93-72fe-425d-95fd-5d2795788f87 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:27.888733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66ef93-72fe-425d-95fd-5d2795788f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:27.889005 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66ef93-72fe-425d-95fd-5d2795788f87 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:27.889707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66ef93-72fe-425d-95fd-5d2795788f87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:27.890018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66ef93-72fe-425d-95fd-5d2795788f87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:27.891486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66ef93-72fe-425d-95fd-5d2795788f87 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:27.903509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 403/833] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:27.909497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66ef93-72fe-425d-95fd-5d2795788f87 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:27.975211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e88076-fed7-4a22-9bb2-2349d2bb1f43 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:28.005515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66ef93-72fe-425d-95fd-5d2795788f87 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:28.010173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c179c6-df56-4104-b209-b30e7ced97b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:28.010912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c179c6-df56-4104-b209-b30e7ced97b9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:28.011190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c179c6-df56-4104-b209-b30e7ced97b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:28.011457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c179c6-df56-4104-b209-b30e7ced97b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:28.012189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c179c6-df56-4104-b209-b30e7ced97b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:28.012491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c179c6-df56-4104-b209-b30e7ced97b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:28.014200 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c179c6-df56-4104-b209-b30e7ced97b9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:28.022325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 431/834] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:28.028354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c179c6-df56-4104-b209-b30e7ced97b9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:28.041209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20c76-3389-409d-8cd5-5e7466fad279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:28.041809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20c76-3389-409d-8cd5-5e7466fad279 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:28.042082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20c76-3389-409d-8cd5-5e7466fad279 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:28.042346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20c76-3389-409d-8cd5-5e7466fad279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:28.043096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20c76-3389-409d-8cd5-5e7466fad279 None admin] RBAC: Adding query filter params (role.id=2543068f563f4327a495ba5e5d4a430a, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=8af81f74f98b478ab71c0b22b365e3da) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:28.043399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20c76-3389-409d-8cd5-5e7466fad279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:28.044793 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20c76-3389-409d-8cd5-5e7466fad279 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:28.050412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 404/835] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:12:27 2022] GET /identity/v3/role_assignments?user.id=8af81f74f98b478ab71c0b22b365e3da&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=2543068f563f4327a495ba5e5d4a430a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:28.052285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:28.137973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c179c6-df56-4104-b209-b30e7ced97b9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:28.174835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b569-6d7c-4867-8db1-b6cf7756ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:28.175495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b569-6d7c-4867-8db1-b6cf7756ffbe None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:28.175772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b569-6d7c-4867-8db1-b6cf7756ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:28.176042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b569-6d7c-4867-8db1-b6cf7756ffbe None admin] PATH_INFO: `/v3/users/27207f91b35142bfa921d52970dfccf9` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:28.177310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86b569-6d7c-4867-8db1-b6cf7756ffbe None admin] RBAC: Authorizing `identity:get_user(user_id=27207f91b35142bfa921d52970dfccf9)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:28.178771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86b569-6d7c-4867-8db1-b6cf7756ffbe None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:28.180453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 432/836] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:12:28 2022] GET /identity/v3/users/27207f91b35142bfa921d52970dfccf9 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:28.186823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20c76-3389-409d-8cd5-5e7466fad279 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:28.224944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:28.294066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20c76-3389-409d-8cd5-5e7466fad279 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:28.328787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1c89d-e092-4c1d-a172-7e652071d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:28.329407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1c89d-e092-4c1d-a172-7e652071d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:28.329685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1c89d-e092-4c1d-a172-7e652071d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:28.329954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1c89d-e092-4c1d-a172-7e652071d9a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:28.398833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1c89d-e092-4c1d-a172-7e652071d9a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:28.400250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1c89d-e092-4c1d-a172-7e652071d9a4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:28.433787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:28.501183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 405/837] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:12:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:28.507042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b569-6d7c-4867-8db1-b6cf7756ffbe None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:28.600604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:28.611080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b569-6d7c-4867-8db1-b6cf7756ffbe None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:28.645365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65746bd4-60f6-43cd-86f0-92bd464a87de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:28.646012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65746bd4-60f6-43cd-86f0-92bd464a87de None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:28.646292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65746bd4-60f6-43cd-86f0-92bd464a87de None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:28.646565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65746bd4-60f6-43cd-86f0-92bd464a87de None admin] PATH_INFO: `/v3/projects/5c38020e60104fb69bee381d85ee57f3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:28.647722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65746bd4-60f6-43cd-86f0-92bd464a87de None admin] RBAC: Authorizing `identity:get_project(project_id=5c38020e60104fb69bee381d85ee57f3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:28.649277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65746bd4-60f6-43cd-86f0-92bd464a87de None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:28.651210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 433/838] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:12:28 2022] GET /identity/v3/projects/5c38020e60104fb69bee381d85ee57f3 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:28.657720 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1c89d-e092-4c1d-a172-7e652071d9a4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:28.759237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1c89d-e092-4c1d-a172-7e652071d9a4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:28.794442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7ac40-76f0-4c6b-83a1-e87c0fe288dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:28.795078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7ac40-76f0-4c6b-83a1-e87c0fe288dd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:28.795355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7ac40-76f0-4c6b-83a1-e87c0fe288dd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:28.795629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7ac40-76f0-4c6b-83a1-e87c0fe288dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:28.796344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7ac40-76f0-4c6b-83a1-e87c0fe288dd None admin] RBAC: Adding query filter params (role.id=72129dcc28d546169fd012284e4019ec, scope.project.id=5c38020e60104fb69bee381d85ee57f3, user.id=27207f91b35142bfa921d52970dfccf9) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:28.796646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7ac40-76f0-4c6b-83a1-e87c0fe288dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:28.798061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7ac40-76f0-4c6b-83a1-e87c0fe288dd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:28.800915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:28.804491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 406/839] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:12:28 2022] GET /identity/v3/role_assignments?user.id=27207f91b35142bfa921d52970dfccf9&scope.project.id=5c38020e60104fb69bee381d85ee57f3&role.id=72129dcc28d546169fd012284e4019ec => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:30.926036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e27c6-886d-4d2c-830e-49ee12382b56 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:30.926925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e27c6-886d-4d2c-830e-49ee12382b56 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:30.926925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e27c6-886d-4d2c-830e-49ee12382b56 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:30.929105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 434/840] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:30.936511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc362840-6942-467a-833d-2673086107a3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:30.936926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc362840-6942-467a-833d-2673086107a3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:30.937076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc362840-6942-467a-833d-2673086107a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:30.965235 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cc362840-6942-467a-833d-2673086107a3 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:30.966434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cc362840-6942-467a-833d-2673086107a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:31.036833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 407/841] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:31.312698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e27c6-886d-4d2c-830e-49ee12382b56 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:31.421951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e27c6-886d-4d2c-830e-49ee12382b56 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:31.455571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422999e-9f65-4595-8f90-557df497c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:31.456192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422999e-9f65-4595-8f90-557df497c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:31.456465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422999e-9f65-4595-8f90-557df497c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:31.456730 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422999e-9f65-4595-8f90-557df497c5a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:31.457881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422999e-9f65-4595-8f90-557df497c5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:31.459573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422999e-9f65-4595-8f90-557df497c5a5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:31.461116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 435/842] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:31.467781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc362840-6942-467a-833d-2673086107a3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:31.572552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc362840-6942-467a-833d-2673086107a3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:31.610017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:31.618260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeeee94-dda4-400e-9b72-1ba21f94dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:31.618981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeee94-dda4-400e-9b72-1ba21f94dfd9 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:31.619258 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeee94-dda4-400e-9b72-1ba21f94dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:31.619524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeee94-dda4-400e-9b72-1ba21f94dfd9 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:31.620173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeeee94-dda4-400e-9b72-1ba21f94dfd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:31.621603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeeee94-dda4-400e-9b72-1ba21f94dfd9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:31.644452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 408/843] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:12:31 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:33.771180 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41ff6e-7a97-417a-9ebf-8c144e00447b None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:33.771781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41ff6e-7a97-417a-9ebf-8c144e00447b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:33.771781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41ff6e-7a97-417a-9ebf-8c144e00447b None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:33.773076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 436/844] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:33.779483 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd2f4f-4bc7-451f-a455-825f75ba0ab7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:33.780215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd2f4f-4bc7-451f-a455-825f75ba0ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:33.780317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd2f4f-4bc7-451f-a455-825f75ba0ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:33.809117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-77cd2f4f-4bc7-451f-a455-825f75ba0ab7 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:33.810311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-77cd2f4f-4bc7-451f-a455-825f75ba0ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:33.892151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 409/845] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:34.154638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41ff6e-7a97-417a-9ebf-8c144e00447b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:34.188882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:34.273608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41ff6e-7a97-417a-9ebf-8c144e00447b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:34.315737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae7ae6-b9cf-4b51-beb0-e5dc842850d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:34.316367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae7ae6-b9cf-4b51-beb0-e5dc842850d1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:34.316645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae7ae6-b9cf-4b51-beb0-e5dc842850d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:34.316915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae7ae6-b9cf-4b51-beb0-e5dc842850d1 None admin] PATH_INFO: `/v3/roles/375d0d25eaa04686ba41303116106916` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:34.318458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae7ae6-b9cf-4b51-beb0-e5dc842850d1 None admin] RBAC: Authorizing `identity:get_role(role_id=375d0d25eaa04686ba41303116106916)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:34.319861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae7ae6-b9cf-4b51-beb0-e5dc842850d1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:34.321166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 437/846] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:12:34 2022] GET /identity/v3/roles/375d0d25eaa04686ba41303116106916 => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:34.327531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd2f4f-4bc7-451f-a455-825f75ba0ab7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:34.433580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd2f4f-4bc7-451f-a455-825f75ba0ab7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:34.451084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:34.472407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5459-c154-4922-9477-ca3eec40bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:34.473041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5459-c154-4922-9477-ca3eec40bb1a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:34.473300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5459-c154-4922-9477-ca3eec40bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:34.473594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5459-c154-4922-9477-ca3eec40bb1a None admin] PATH_INFO: `/v3/users/cf6329f15f3d48fe9488e53c6d052400` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:34.487234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c5459-c154-4922-9477-ca3eec40bb1a None admin] RBAC: Authorizing `identity:get_user(user_id=cf6329f15f3d48fe9488e53c6d052400)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:34.488699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c5459-c154-4922-9477-ca3eec40bb1a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:34.490304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 410/847] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:12:34 2022] GET /identity/v3/users/cf6329f15f3d48fe9488e53c6d052400 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:34.496232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae7ae6-b9cf-4b51-beb0-e5dc842850d1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:34.600702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:34.608592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae7ae6-b9cf-4b51-beb0-e5dc842850d1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:34.644674 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ecbae-3b03-4ea8-bd40-355e5283f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:34.645308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ecbae-3b03-4ea8-bd40-355e5283f34c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:34.645588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ecbae-3b03-4ea8-bd40-355e5283f34c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:34.645857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ecbae-3b03-4ea8-bd40-355e5283f34c None admin] PATH_INFO: `/v3/projects/5c38020e60104fb69bee381d85ee57f3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:34.647047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ecbae-3b03-4ea8-bd40-355e5283f34c None admin] RBAC: Authorizing `identity:get_project(project_id=5c38020e60104fb69bee381d85ee57f3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:34.648481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ecbae-3b03-4ea8-bd40-355e5283f34c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:34.650207 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 438/848] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:12:34 2022] GET /identity/v3/projects/5c38020e60104fb69bee381d85ee57f3 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:34.657078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5459-c154-4922-9477-ca3eec40bb1a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:34.788247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5459-c154-4922-9477-ca3eec40bb1a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:34.823508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8cdba-1517-4959-8d3f-90476d69f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:34.824155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8cdba-1517-4959-8d3f-90476d69f348 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:34.824434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8cdba-1517-4959-8d3f-90476d69f348 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:34.824689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8cdba-1517-4959-8d3f-90476d69f348 None admin] PATH_INFO: `/v3/projects/5c38020e60104fb69bee381d85ee57f3/users/cf6329f15f3d48fe9488e53c6d052400/roles/375d0d25eaa04686ba41303116106916` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:34.826898 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8cdba-1517-4959-8d3f-90476d69f348 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c38020e60104fb69bee381d85ee57f3, user_id=cf6329f15f3d48fe9488e53c6d052400, role_id=375d0d25eaa04686ba41303116106916)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:34.828312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8cdba-1517-4959-8d3f-90476d69f348 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:34.843339 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 411/849] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:12:34 2022] PUT /identity/v3/projects/5c38020e60104fb69bee381d85ee57f3/users/cf6329f15f3d48fe9488e53c6d052400/roles/375d0d25eaa04686ba41303116106916 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:12:36.933715 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417c09-2f9e-4ffa-9795-bf0a9e91c59b None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:36.934538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417c09-2f9e-4ffa-9795-bf0a9e91c59b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:36.934538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417c09-2f9e-4ffa-9795-bf0a9e91c59b None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:36.936743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 439/850] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:36.944789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeae79-7f68-4f55-96ae-87fdc1fbeef4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:36.945253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeae79-7f68-4f55-96ae-87fdc1fbeef4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:36.945344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeae79-7f68-4f55-96ae-87fdc1fbeef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:36.965459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0dfeae79-7f68-4f55-96ae-87fdc1fbeef4 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:36.966633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0dfeae79-7f68-4f55-96ae-87fdc1fbeef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:37.000539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:37.043818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 412/851] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:37.304239 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417c09-2f9e-4ffa-9795-bf0a9e91c59b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:37.410403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417c09-2f9e-4ffa-9795-bf0a9e91c59b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:37.445023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562b8ab-8a34-472a-bca9-df3c1bfadff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:37.445643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562b8ab-8a34-472a-bca9-df3c1bfadff3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:37.445919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562b8ab-8a34-472a-bca9-df3c1bfadff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:37.446193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562b8ab-8a34-472a-bca9-df3c1bfadff3 None admin] PATH_INFO: `/v3/roles/375d0d25eaa04686ba41303116106916` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:37.447713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562b8ab-8a34-472a-bca9-df3c1bfadff3 None admin] RBAC: Authorizing `identity:get_role(role_id=375d0d25eaa04686ba41303116106916)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:37.449071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562b8ab-8a34-472a-bca9-df3c1bfadff3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:37.450374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 440/852] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:12:37 2022] GET /identity/v3/roles/375d0d25eaa04686ba41303116106916 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:37.456261 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeae79-7f68-4f55-96ae-87fdc1fbeef4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:37.567086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeae79-7f68-4f55-96ae-87fdc1fbeef4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:37.609533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819b9a7-f441-46e6-a408-0bda2f79ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:37.610153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819b9a7-f441-46e6-a408-0bda2f79ee50 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:37.610428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819b9a7-f441-46e6-a408-0bda2f79ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:37.610695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819b9a7-f441-46e6-a408-0bda2f79ee50 None admin] PATH_INFO: `/v3/users/cf6329f15f3d48fe9488e53c6d052400` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:37.611888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819b9a7-f441-46e6-a408-0bda2f79ee50 None admin] RBAC: Authorizing `identity:get_user(user_id=cf6329f15f3d48fe9488e53c6d052400)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:37.613312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819b9a7-f441-46e6-a408-0bda2f79ee50 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:37.614885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 413/853] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:12:37 2022] GET /identity/v3/users/cf6329f15f3d48fe9488e53c6d052400 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:37.621423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562b8ab-8a34-472a-bca9-df3c1bfadff3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:37.652926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:37.732802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562b8ab-8a34-472a-bca9-df3c1bfadff3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:37.768467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c26df0-1bce-4002-a1a5-2819739aa2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:37.769068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c26df0-1bce-4002-a1a5-2819739aa2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:37.769353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c26df0-1bce-4002-a1a5-2819739aa2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:37.769618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c26df0-1bce-4002-a1a5-2819739aa2c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:37.839645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c26df0-1bce-4002-a1a5-2819739aa2c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:37.841020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c26df0-1bce-4002-a1a5-2819739aa2c6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:37.871676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:37.943004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 441/854] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:12:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:37.949975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819b9a7-f441-46e6-a408-0bda2f79ee50 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:37.991656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:38.060899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819b9a7-f441-46e6-a408-0bda2f79ee50 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:38.098085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbcdcc-8b3d-4e2a-bf04-f2a4cb791dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:38.098645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbcdcc-8b3d-4e2a-bf04-f2a4cb791dcb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:38.098955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbcdcc-8b3d-4e2a-bf04-f2a4cb791dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:38.099228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbcdcc-8b3d-4e2a-bf04-f2a4cb791dcb None admin] PATH_INFO: `/v3/projects/5c38020e60104fb69bee381d85ee57f3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:38.100460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbcdcc-8b3d-4e2a-bf04-f2a4cb791dcb None admin] RBAC: Authorizing `identity:get_project(project_id=5c38020e60104fb69bee381d85ee57f3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:38.101877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbcdcc-8b3d-4e2a-bf04-f2a4cb791dcb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:38.103580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 414/855] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:12:37 2022] GET /identity/v3/projects/5c38020e60104fb69bee381d85ee57f3 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:38.110570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c26df0-1bce-4002-a1a5-2819739aa2c6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:38.225373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c26df0-1bce-4002-a1a5-2819739aa2c6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:38.258922 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:38.266119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5bedd-595c-456f-821d-cf2ca8f6f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:38.266752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5bedd-595c-456f-821d-cf2ca8f6f497 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:38.267039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5bedd-595c-456f-821d-cf2ca8f6f497 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:38.267308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5bedd-595c-456f-821d-cf2ca8f6f497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:38.268042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5bedd-595c-456f-821d-cf2ca8f6f497 None admin] RBAC: Adding query filter params (role.id=375d0d25eaa04686ba41303116106916, scope.project.id=5c38020e60104fb69bee381d85ee57f3, user.id=cf6329f15f3d48fe9488e53c6d052400) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:38.268350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5bedd-595c-456f-821d-cf2ca8f6f497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:38.269786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5bedd-595c-456f-821d-cf2ca8f6f497 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:38.276399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 442/856] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:12:38 2022] GET /identity/v3/role_assignments?user.id=cf6329f15f3d48fe9488e53c6d052400&scope.project.id=5c38020e60104fb69bee381d85ee57f3&role.id=375d0d25eaa04686ba41303116106916 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:40.366407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76d190-08b8-4400-ba37-3f78e4d92b88 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:40.367010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76d190-08b8-4400-ba37-3f78e4d92b88 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:40.367010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76d190-08b8-4400-ba37-3f78e4d92b88 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:40.368332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 415/857] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:40.374656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a863be-8569-43d2-86e6-d6894ae64c0a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:40.375347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a863be-8569-43d2-86e6-d6894ae64c0a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:40.375531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a863be-8569-43d2-86e6-d6894ae64c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:40.399702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-88a863be-8569-43d2-86e6-d6894ae64c0a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:40.400904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-88a863be-8569-43d2-86e6-d6894ae64c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:40.474391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 443/858] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:40.740097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76d190-08b8-4400-ba37-3f78e4d92b88 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:40.847015 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:40.851627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76d190-08b8-4400-ba37-3f78e4d92b88 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:40.890605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e14473-99c1-4710-a0be-3fb882e5104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:40.891590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e14473-99c1-4710-a0be-3fb882e5104f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:40.891985 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e14473-99c1-4710-a0be-3fb882e5104f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:40.892393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e14473-99c1-4710-a0be-3fb882e5104f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:40.894281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e14473-99c1-4710-a0be-3fb882e5104f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:40.896912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e14473-99c1-4710-a0be-3fb882e5104f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:40.899195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 416/859] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:40.905396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a863be-8569-43d2-86e6-d6894ae64c0a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:41.005951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a863be-8569-43d2-86e6-d6894ae64c0a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:41.029513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:41.041313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b71246-55ef-4458-9e52-70efba3a6649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:41.041965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b71246-55ef-4458-9e52-70efba3a6649 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:41.042241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b71246-55ef-4458-9e52-70efba3a6649 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:41.042507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b71246-55ef-4458-9e52-70efba3a6649 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:41.043188 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b71246-55ef-4458-9e52-70efba3a6649 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:41.044605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b71246-55ef-4458-9e52-70efba3a6649 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:41.077182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 444/860] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:12:40 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:43.226480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364371-b18a-4487-98ae-8b3d3a481ea3 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:43.227062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364371-b18a-4487-98ae-8b3d3a481ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:43.227062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364371-b18a-4487-98ae-8b3d3a481ea3 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:43.228418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 417/861] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:43.234984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b7f5-79ab-4eaf-9733-31813a7578a4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:43.235705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b7f5-79ab-4eaf-9733-31813a7578a4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:43.235838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b7f5-79ab-4eaf-9733-31813a7578a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:43.265472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-98e7b7f5-79ab-4eaf-9733-31813a7578a4 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:43.266682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-98e7b7f5-79ab-4eaf-9733-31813a7578a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:43.348669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 445/862] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:43.630833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f364371-b18a-4487-98ae-8b3d3a481ea3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:43.753771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f364371-b18a-4487-98ae-8b3d3a481ea3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:43.789971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f051207-210e-4ccf-af1c-5b58ae8e61dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:43.790596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f051207-210e-4ccf-af1c-5b58ae8e61dc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:43.790903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f051207-210e-4ccf-af1c-5b58ae8e61dc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:43.791176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f051207-210e-4ccf-af1c-5b58ae8e61dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:43.792414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f051207-210e-4ccf-af1c-5b58ae8e61dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:43.793879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f051207-210e-4ccf-af1c-5b58ae8e61dc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:43.795448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 418/863] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:12:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:43.801307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7b7f5-79ab-4eaf-9733-31813a7578a4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:43.911669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7b7f5-79ab-4eaf-9733-31813a7578a4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:43.918930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:43.948595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7f1fa-5012-44d4-88c4-fa6d15fc21a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:43.949199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7f1fa-5012-44d4-88c4-fa6d15fc21a9 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:43.949477 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7f1fa-5012-44d4-88c4-fa6d15fc21a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:43.949746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7f1fa-5012-44d4-88c4-fa6d15fc21a9 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:43.950399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7f1fa-5012-44d4-88c4-fa6d15fc21a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:43.951867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7f1fa-5012-44d4-88c4-fa6d15fc21a9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:43.974203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 446/864] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:12:43 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:12:46.091657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9cb77-c4e8-4b79-8606-01802c4d1d4d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:46.092535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9cb77-c4e8-4b79-8606-01802c4d1d4d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:46.092535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9cb77-c4e8-4b79-8606-01802c4d1d4d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:46.094776 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 419/865] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:46.100934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e0e8c-62ee-49b6-9617-5c8bee9ae78d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:46.101355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e0e8c-62ee-49b6-9617-5c8bee9ae78d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:46.101495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e0e8c-62ee-49b6-9617-5c8bee9ae78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:46.121695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ef2e0e8c-62ee-49b6-9617-5c8bee9ae78d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:46.122934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ef2e0e8c-62ee-49b6-9617-5c8bee9ae78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:46.192107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 447/866] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:46.464537 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9cb77-c4e8-4b79-8606-01802c4d1d4d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:46.514097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:46.585526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9cb77-c4e8-4b79-8606-01802c4d1d4d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:46.626329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba807f-da9d-4ef0-8072-8f4c9fbc357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:46.626987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba807f-da9d-4ef0-8072-8f4c9fbc357e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:46.627268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba807f-da9d-4ef0-8072-8f4c9fbc357e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:46.627541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba807f-da9d-4ef0-8072-8f4c9fbc357e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:46.645661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba807f-da9d-4ef0-8072-8f4c9fbc357e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-77ba807f-da9d-4ef0-8072-8f4c9fbc357e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:12:46.652889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:46.653961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:12:46.654979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 420/867] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:46.660341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e0e8c-62ee-49b6-9617-5c8bee9ae78d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:46.877130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:46.888472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e0e8c-62ee-49b6-9617-5c8bee9ae78d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:46.922420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69522f99-60fe-4933-b923-7e984a3a320e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:46.923053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69522f99-60fe-4933-b923-7e984a3a320e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:46.923330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69522f99-60fe-4933-b923-7e984a3a320e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:46.923600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69522f99-60fe-4933-b923-7e984a3a320e None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:46.924261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69522f99-60fe-4933-b923-7e984a3a320e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:46.924563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69522f99-60fe-4933-b923-7e984a3a320e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:46.925933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69522f99-60fe-4933-b923-7e984a3a320e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:46.934054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 448/868] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:46.940337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba807f-da9d-4ef0-8072-8f4c9fbc357e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:47.035799 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:47.042188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba807f-da9d-4ef0-8072-8f4c9fbc357e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:47.077208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039816a-6681-411b-a7b9-afbb1cfb8260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:47.077817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039816a-6681-411b-a7b9-afbb1cfb8260 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:47.078092 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039816a-6681-411b-a7b9-afbb1cfb8260 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:47.078357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039816a-6681-411b-a7b9-afbb1cfb8260 None admin] PATH_INFO: `/v3/users/1604abfdae4d4c31b6129871ee4746a9` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:47.091929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039816a-6681-411b-a7b9-afbb1cfb8260 None admin] RBAC: Authorizing `identity:get_user(user_id=1604abfdae4d4c31b6129871ee4746a9)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:47.093416 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039816a-6681-411b-a7b9-afbb1cfb8260 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:47.095031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 421/869] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:12:46 2022] GET /identity/v3/users/1604abfdae4d4c31b6129871ee4746a9 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:47.101107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69522f99-60fe-4933-b923-7e984a3a320e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:47.201074 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69522f99-60fe-4933-b923-7e984a3a320e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:47.235196 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17effc7f-227b-471e-87f7-38a32e0c6348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:47.235811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17effc7f-227b-471e-87f7-38a32e0c6348 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:47.236081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17effc7f-227b-471e-87f7-38a32e0c6348 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:47.236346 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17effc7f-227b-471e-87f7-38a32e0c6348 None admin] PATH_INFO: `/v3/projects/00eda3e5a8764887a648a3bc20ad28cf` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:47.237563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17effc7f-227b-471e-87f7-38a32e0c6348 None admin] RBAC: Authorizing `identity:get_project(project_id=00eda3e5a8764887a648a3bc20ad28cf)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:47.238991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17effc7f-227b-471e-87f7-38a32e0c6348 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:47.240568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 449/870] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:12:47 2022] GET /identity/v3/projects/00eda3e5a8764887a648a3bc20ad28cf => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:47.246612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039816a-6681-411b-a7b9-afbb1cfb8260 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:47.355989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039816a-6681-411b-a7b9-afbb1cfb8260 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:47.393428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bf17e-8309-4fbd-9d01-c9d2f889a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:47.394064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bf17e-8309-4fbd-9d01-c9d2f889a52e None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:47.394341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bf17e-8309-4fbd-9d01-c9d2f889a52e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:47.394578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bf17e-8309-4fbd-9d01-c9d2f889a52e None admin] PATH_INFO: `/v3/projects/00eda3e5a8764887a648a3bc20ad28cf/users/1604abfdae4d4c31b6129871ee4746a9/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:47.396590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bf17e-8309-4fbd-9d01-c9d2f889a52e None admin] RBAC: Authorizing `identity:create_grant(project_id=00eda3e5a8764887a648a3bc20ad28cf, user_id=1604abfdae4d4c31b6129871ee4746a9, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:47.397999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bf17e-8309-4fbd-9d01-c9d2f889a52e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:47.413832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 422/871] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:12:47 2022] PUT /identity/v3/projects/00eda3e5a8764887a648a3bc20ad28cf/users/1604abfdae4d4c31b6129871ee4746a9/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:12:49.492807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45ea9-398f-46d6-a9e6-f90f534ce878 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:49.493373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45ea9-398f-46d6-a9e6-f90f534ce878 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:49.493373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45ea9-398f-46d6-a9e6-f90f534ce878 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:49.495465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 450/872] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:49.500719 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952056-558f-4906-aa89-5f7f17a1cb55 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:49.501163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952056-558f-4906-aa89-5f7f17a1cb55 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:49.501255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952056-558f-4906-aa89-5f7f17a1cb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:49.520067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-36952056-558f-4906-aa89-5f7f17a1cb55 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:49.521230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-36952056-558f-4906-aa89-5f7f17a1cb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:49.530956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:49.594482 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 423/873] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:49.859300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45ea9-398f-46d6-a9e6-f90f534ce878 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:49.894324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:49.972110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45ea9-398f-46d6-a9e6-f90f534ce878 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.008857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f488962-ba88-444f-8b78-572b023a2f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:50.009877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f488962-ba88-444f-8b78-572b023a2f66 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.010313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f488962-ba88-444f-8b78-572b023a2f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.010817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f488962-ba88-444f-8b78-572b023a2f66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.022582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f488962-ba88-444f-8b78-572b023a2f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-9f488962-ba88-444f-8b78-572b023a2f66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:12:50.027491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:12:50.028531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:12:50.029447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 451/874] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:12:50.034859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36952056-558f-4906-aa89-5f7f17a1cb55 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:50.150365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36952056-558f-4906-aa89-5f7f17a1cb55 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.185700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6d7a-de6d-4489-b8c2-b956c46e096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:50.186308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6d7a-de6d-4489-b8c2-b956c46e096e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.186638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6d7a-de6d-4489-b8c2-b956c46e096e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.186891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6d7a-de6d-4489-b8c2-b956c46e096e None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.187554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6d7a-de6d-4489-b8c2-b956c46e096e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:50.187854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6d7a-de6d-4489-b8c2-b956c46e096e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:50.189202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6d7a-de6d-4489-b8c2-b956c46e096e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:50.197327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 424/875] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:12:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:50.207735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f488962-ba88-444f-8b78-572b023a2f66 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:50.307384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:50.327174 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f488962-ba88-444f-8b78-572b023a2f66 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.360057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2825-f0bc-43bd-a69a-78fb1fa5d592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:50.360685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2825-f0bc-43bd-a69a-78fb1fa5d592 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.360966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2825-f0bc-43bd-a69a-78fb1fa5d592 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.361236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2825-f0bc-43bd-a69a-78fb1fa5d592 None admin] PATH_INFO: `/v3/users/1604abfdae4d4c31b6129871ee4746a9` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.362486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e2825-f0bc-43bd-a69a-78fb1fa5d592 None admin] RBAC: Authorizing `identity:get_user(user_id=1604abfdae4d4c31b6129871ee4746a9)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:50.363943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e2825-f0bc-43bd-a69a-78fb1fa5d592 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:50.365522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 452/876] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:12:50 2022] GET /identity/v3/users/1604abfdae4d4c31b6129871ee4746a9 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:50.371887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6d7a-de6d-4489-b8c2-b956c46e096e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:50.381723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:50.474188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6d7a-de6d-4489-b8c2-b956c46e096e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.508904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15e902-c0fa-44c8-b977-1db0359eef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:50.509502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15e902-c0fa-44c8-b977-1db0359eef43 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.509760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15e902-c0fa-44c8-b977-1db0359eef43 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.510027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15e902-c0fa-44c8-b977-1db0359eef43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.578497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15e902-c0fa-44c8-b977-1db0359eef43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:50.579966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15e902-c0fa-44c8-b977-1db0359eef43 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:50.587349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:50.681591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 425/877] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:12:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:12:50.691273 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2825-f0bc-43bd-a69a-78fb1fa5d592 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:50.805110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2825-f0bc-43bd-a69a-78fb1fa5d592 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.848512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664a8df-3762-446a-bdd2-23d2e51ee0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:50.849143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a8df-3762-446a-bdd2-23d2e51ee0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.849416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a8df-3762-446a-bdd2-23d2e51ee0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.849686 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a8df-3762-446a-bdd2-23d2e51ee0e6 None admin] PATH_INFO: `/v3/projects/00eda3e5a8764887a648a3bc20ad28cf` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.850921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664a8df-3762-446a-bdd2-23d2e51ee0e6 None admin] RBAC: Authorizing `identity:get_project(project_id=00eda3e5a8764887a648a3bc20ad28cf)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:50.852628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664a8df-3762-446a-bdd2-23d2e51ee0e6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:50.854238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 453/878] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:12:50 2022] GET /identity/v3/projects/00eda3e5a8764887a648a3bc20ad28cf => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:50.860841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15e902-c0fa-44c8-b977-1db0359eef43 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:50.962886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15e902-c0fa-44c8-b977-1db0359eef43 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.970160 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:50.999926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2472f-5653-4a16-b393-734ecef96e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:51.000519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2472f-5653-4a16-b393-734ecef96e68 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:51.000792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2472f-5653-4a16-b393-734ecef96e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:51.001052 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2472f-5653-4a16-b393-734ecef96e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:51.001755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2472f-5653-4a16-b393-734ecef96e68 None admin] RBAC: Adding query filter params (role.id=72129dcc28d546169fd012284e4019ec, scope.project.id=00eda3e5a8764887a648a3bc20ad28cf, user.id=1604abfdae4d4c31b6129871ee4746a9) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:51.002054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2472f-5653-4a16-b393-734ecef96e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:51.003506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2472f-5653-4a16-b393-734ecef96e68 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:51.009369 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 426/879] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:12:50 2022] GET /identity/v3/role_assignments?user.id=1604abfdae4d4c31b6129871ee4746a9&scope.project.id=00eda3e5a8764887a648a3bc20ad28cf&role.id=72129dcc28d546169fd012284e4019ec => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:53.130893 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377ad93-d662-492e-ad39-e0f70804270a None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:53.131726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377ad93-d662-492e-ad39-e0f70804270a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:53.131726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377ad93-d662-492e-ad39-e0f70804270a None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:53.133782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 454/880] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:53.140541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab9a23-d849-4814-9a43-9c6860653e42 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:53.140986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab9a23-d849-4814-9a43-9c6860653e42 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:53.141101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab9a23-d849-4814-9a43-9c6860653e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:53.170302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b8ab9a23-d849-4814-9a43-9c6860653e42 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:53.171522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b8ab9a23-d849-4814-9a43-9c6860653e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:53.243312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 427/881] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:53.506952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377ad93-d662-492e-ad39-e0f70804270a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:53.529704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:53.609820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377ad93-d662-492e-ad39-e0f70804270a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:53.644661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bf19d-388c-4838-94dd-b74f535cb8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:53.645253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bf19d-388c-4838-94dd-b74f535cb8b5 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:53.645528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bf19d-388c-4838-94dd-b74f535cb8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:53.645790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bf19d-388c-4838-94dd-b74f535cb8b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:53.646458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bf19d-388c-4838-94dd-b74f535cb8b5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:53.647842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bf19d-388c-4838-94dd-b74f535cb8b5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:53.668851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 455/882] 10.222.0.23 () {60 vars in 1138 bytes} [Thu Oct 27 01:12:53 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:12:55.793545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6bc7b-b4a5-4127-a46d-6a8670055708 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:55.794173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6bc7b-b4a5-4127-a46d-6a8670055708 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:55.794173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6bc7b-b4a5-4127-a46d-6a8670055708 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:55.795455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 428/883] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:55.801869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e087d4-cf87-4d38-bbc5-35d4d727965a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:55.802612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e087d4-cf87-4d38-bbc5-35d4d727965a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:55.802788 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e087d4-cf87-4d38-bbc5-35d4d727965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:55.823840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b7e087d4-cf87-4d38-bbc5-35d4d727965a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:55.825063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b7e087d4-cf87-4d38-bbc5-35d4d727965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:55.897012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 456/884] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:56.169191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6bc7b-b4a5-4127-a46d-6a8670055708 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:56.275060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:56.279752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6bc7b-b4a5-4127-a46d-6a8670055708 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:56.314983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ba753-3d81-42c8-82d5-3f708d03db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:56.315654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ba753-3d81-42c8-82d5-3f708d03db36 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:56.315929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ba753-3d81-42c8-82d5-3f708d03db36 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:56.316217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ba753-3d81-42c8-82d5-3f708d03db36 None admin] PATH_INFO: `/v3/domains/da2a34bc74b24232897978c144608ec8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:56.327286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ba753-3d81-42c8-82d5-3f708d03db36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=da2a34bc74b24232897978c144608ec8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:56.328746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ba753-3d81-42c8-82d5-3f708d03db36 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:56.335242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 429/885] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Oct 27 01:12:56 2022] GET /identity/v3/domains/da2a34bc74b24232897978c144608ec8 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:56.336396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e087d4-cf87-4d38-bbc5-35d4d727965a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:56.347319 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:56.434285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e087d4-cf87-4d38-bbc5-35d4d727965a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:56.468023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273f8c1-1927-48c0-a937-c2b7902c4dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:56.468636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273f8c1-1927-48c0-a937-c2b7902c4dd9 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:56.468910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273f8c1-1927-48c0-a937-c2b7902c4dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:56.469177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273f8c1-1927-48c0-a937-c2b7902c4dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:56.469847 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273f8c1-1927-48c0-a937-c2b7902c4dd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:56.471316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273f8c1-1927-48c0-a937-c2b7902c4dd9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:56.497531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 457/886] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:12:56 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:12:58.652849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1715b-d776-4c52-97a9-4d0d017eff11 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:58.653421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1715b-d776-4c52-97a9-4d0d017eff11 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:58.653421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1715b-d776-4c52-97a9-4d0d017eff11 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:58.654748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 430/887] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:58.660286 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea49e2-40f7-4e16-8a89-eb0782cc09cb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:58.660712 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea49e2-40f7-4e16-8a89-eb0782cc09cb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:58.660808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea49e2-40f7-4e16-8a89-eb0782cc09cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:58.680711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2bea49e2-40f7-4e16-8a89-eb0782cc09cb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:58.681896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2bea49e2-40f7-4e16-8a89-eb0782cc09cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:58.742011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:12:58.754308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 458/888] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:12:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:12:59.020569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1715b-d776-4c52-97a9-4d0d017eff11 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:59.151639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1715b-d776-4c52-97a9-4d0d017eff11 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:59.187479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d0550-e57f-4d3c-903a-63e1ea3cdf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:59.188105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0550-e57f-4d3c-903a-63e1ea3cdf2c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:59.188384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0550-e57f-4d3c-903a-63e1ea3cdf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:59.188658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d0550-e57f-4d3c-903a-63e1ea3cdf2c None admin] PATH_INFO: `/v3/domains/da2a34bc74b24232897978c144608ec8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:59.189910 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0550-e57f-4d3c-903a-63e1ea3cdf2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=da2a34bc74b24232897978c144608ec8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:59.191383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d0550-e57f-4d3c-903a-63e1ea3cdf2c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:59.192933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 431/889] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Oct 27 01:12:59 2022] GET /identity/v3/domains/da2a34bc74b24232897978c144608ec8 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:59.198978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea49e2-40f7-4e16-8a89-eb0782cc09cb None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:59.305321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea49e2-40f7-4e16-8a89-eb0782cc09cb None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:59.340132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eed719-2b51-4afd-9772-6d6a400f1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:59.340740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed719-2b51-4afd-9772-6d6a400f1658 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:59.341021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed719-2b51-4afd-9772-6d6a400f1658 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:59.341290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed719-2b51-4afd-9772-6d6a400f1658 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:59.341950 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eed719-2b51-4afd-9772-6d6a400f1658 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:59.343423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eed719-2b51-4afd-9772-6d6a400f1658 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:59.369156 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 459/890] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:12:59 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:13:01.522088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b262a3-4468-43b9-9dc1-740536b6150e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:01.522758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b262a3-4468-43b9-9dc1-740536b6150e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:01.522758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b262a3-4468-43b9-9dc1-740536b6150e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:01.524016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 432/891] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:01.530580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a119c1-855a-4936-9494-3989fda55b33 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:01.531400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a119c1-855a-4936-9494-3989fda55b33 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:01.531558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a119c1-855a-4936-9494-3989fda55b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:01.561424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d8a119c1-855a-4936-9494-3989fda55b33 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:01.562606 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d8a119c1-855a-4936-9494-3989fda55b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:01.605436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:01.631933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 460/892] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:13:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:13:01.894141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b262a3-4468-43b9-9dc1-740536b6150e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:01.933508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:02.019357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b262a3-4468-43b9-9dc1-740536b6150e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:02.054511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28361a-1ac5-403c-ad5d-19fad741b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:02.055162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28361a-1ac5-403c-ad5d-19fad741b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:02.055439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28361a-1ac5-403c-ad5d-19fad741b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:02.055704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28361a-1ac5-403c-ad5d-19fad741b4d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:02.070032 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28361a-1ac5-403c-ad5d-19fad741b4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9c28361a-1ac5-403c-ad5d-19fad741b4d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:13:02.076777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:13:02.077904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:13:02.078997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 433/893] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:13:02.084631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a119c1-855a-4936-9494-3989fda55b33 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:02.193581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a119c1-855a-4936-9494-3989fda55b33 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:02.231291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22693b4b-8dc5-4fb5-a698-0f516dce08c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:02.231895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22693b4b-8dc5-4fb5-a698-0f516dce08c0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:02.232168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22693b4b-8dc5-4fb5-a698-0f516dce08c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:02.232440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22693b4b-8dc5-4fb5-a698-0f516dce08c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:02.233111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22693b4b-8dc5-4fb5-a698-0f516dce08c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:13:02.233413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22693b4b-8dc5-4fb5-a698-0f516dce08c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:02.234805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22693b4b-8dc5-4fb5-a698-0f516dce08c0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:02.243596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 461/894] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:02.250633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28361a-1ac5-403c-ad5d-19fad741b4d6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:02.341121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:02.355188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28361a-1ac5-403c-ad5d-19fad741b4d6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:02.392050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbab95-cc55-4508-9fbb-183c64827cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:02.392675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbab95-cc55-4508-9fbb-183c64827cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:02.392955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbab95-cc55-4508-9fbb-183c64827cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:02.393224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbab95-cc55-4508-9fbb-183c64827cc9 None admin] PATH_INFO: `/v3/users/ca79975feb024fb9bc176447b1dc8507` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:02.407192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbab95-cc55-4508-9fbb-183c64827cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=ca79975feb024fb9bc176447b1dc8507)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:02.408631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbab95-cc55-4508-9fbb-183c64827cc9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:02.410219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 434/895] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:13:02 2022] GET /identity/v3/users/ca79975feb024fb9bc176447b1dc8507 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:02.416782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22693b4b-8dc5-4fb5-a698-0f516dce08c0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:02.468589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:02.541098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22693b4b-8dc5-4fb5-a698-0f516dce08c0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:02.575488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e38220-2740-4fc0-b0a8-2c8965eeb1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:02.576108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e38220-2740-4fc0-b0a8-2c8965eeb1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:02.576382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e38220-2740-4fc0-b0a8-2c8965eeb1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:02.576653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e38220-2740-4fc0-b0a8-2c8965eeb1b9 None admin] PATH_INFO: `/v3/projects/0ec763e623e14b4bb64a516e7d0a00e1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:02.577807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e38220-2740-4fc0-b0a8-2c8965eeb1b9 None admin] RBAC: Authorizing `identity:get_project(project_id=0ec763e623e14b4bb64a516e7d0a00e1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:02.579247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e38220-2740-4fc0-b0a8-2c8965eeb1b9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:02.580834 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 462/896] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:13:02 2022] GET /identity/v3/projects/0ec763e623e14b4bb64a516e7d0a00e1 => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:02.586981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbab95-cc55-4508-9fbb-183c64827cc9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:02.703456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbab95-cc55-4508-9fbb-183c64827cc9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:02.862882 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2f794-0408-4256-a320-d4bf0664c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:02.863553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2f794-0408-4256-a320-d4bf0664c085 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:02.863832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2f794-0408-4256-a320-d4bf0664c085 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:02.864101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2f794-0408-4256-a320-d4bf0664c085 None admin] PATH_INFO: `/v3/projects/0ec763e623e14b4bb64a516e7d0a00e1/users/ca79975feb024fb9bc176447b1dc8507/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:02.866123 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2f794-0408-4256-a320-d4bf0664c085 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec763e623e14b4bb64a516e7d0a00e1, user_id=ca79975feb024fb9bc176447b1dc8507, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:02.867561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2f794-0408-4256-a320-d4bf0664c085 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:02.884178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 435/897] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:13:02 2022] PUT /identity/v3/projects/0ec763e623e14b4bb64a516e7d0a00e1/users/ca79975feb024fb9bc176447b1dc8507/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:13:04.993251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828559e7-f66d-4f5e-924f-d5c8539927ef None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:04.994090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828559e7-f66d-4f5e-924f-d5c8539927ef None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:04.994090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828559e7-f66d-4f5e-924f-d5c8539927ef None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:04.996376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 463/898] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:13:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:05.004813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1366a-4b27-4089-9818-1f9d24b75b4d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:05.005280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1366a-4b27-4089-9818-1f9d24b75b4d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:05.005379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1366a-4b27-4089-9818-1f9d24b75b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:05.019383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:05.024980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8ab1366a-4b27-4089-9818-1f9d24b75b4d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:05.026771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8ab1366a-4b27-4089-9818-1f9d24b75b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:05.094357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 436/899] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:13:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:13:05.361788 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828559e7-f66d-4f5e-924f-d5c8539927ef None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:05.472331 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828559e7-f66d-4f5e-924f-d5c8539927ef None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:05.479450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:05.513611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ad02c-9004-4c3c-9f26-e46b66804c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:05.514228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ad02c-9004-4c3c-9f26-e46b66804c50 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:05.514503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ad02c-9004-4c3c-9f26-e46b66804c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:05.514802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ad02c-9004-4c3c-9f26-e46b66804c50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:05.525506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ad02c-9004-4c3c-9f26-e46b66804c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-7b4ad02c-9004-4c3c-9f26-e46b66804c50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:13:05.530391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:13:05.531514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:13:05.532467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 464/900] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:13:05.537693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1366a-4b27-4089-9818-1f9d24b75b4d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:05.643560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1366a-4b27-4089-9818-1f9d24b75b4d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:05.682458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dea8b-8e5b-4da3-b315-0a352830d474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:05.683107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dea8b-8e5b-4da3-b315-0a352830d474 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:05.683387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dea8b-8e5b-4da3-b315-0a352830d474 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:05.683659 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dea8b-8e5b-4da3-b315-0a352830d474 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:05.684335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dea8b-8e5b-4da3-b315-0a352830d474 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:13:05.684641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dea8b-8e5b-4da3-b315-0a352830d474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:05.686008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dea8b-8e5b-4da3-b315-0a352830d474 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:05.688263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:05.695151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 437/901] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:05.702926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ad02c-9004-4c3c-9f26-e46b66804c50 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:05.811651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ad02c-9004-4c3c-9f26-e46b66804c50 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:05.847772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35d35-9de3-4228-88fc-cfec887172d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:05.848411 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35d35-9de3-4228-88fc-cfec887172d5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:05.848689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35d35-9de3-4228-88fc-cfec887172d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:05.848959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35d35-9de3-4228-88fc-cfec887172d5 None admin] PATH_INFO: `/v3/users/ca79975feb024fb9bc176447b1dc8507` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:05.850128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff35d35-9de3-4228-88fc-cfec887172d5 None admin] RBAC: Authorizing `identity:get_user(user_id=ca79975feb024fb9bc176447b1dc8507)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:05.851581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff35d35-9de3-4228-88fc-cfec887172d5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:05.853160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 465/902] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Oct 27 01:13:05 2022] GET /identity/v3/users/ca79975feb024fb9bc176447b1dc8507 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:13:05.859451 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dea8b-8e5b-4da3-b315-0a352830d474 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:05.968229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dea8b-8e5b-4da3-b315-0a352830d474 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:06.003268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9afe1-3b35-4d15-be0c-53498a32a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:06.003872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9afe1-3b35-4d15-be0c-53498a32a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:06.004153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9afe1-3b35-4d15-be0c-53498a32a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:06.004417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9afe1-3b35-4d15-be0c-53498a32a2f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:06.071613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:06.074879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9afe1-3b35-4d15-be0c-53498a32a2f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:06.076392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9afe1-3b35-4d15-be0c-53498a32a2f1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:06.175457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 438/903] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:13:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:13:06.184976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35d35-9de3-4228-88fc-cfec887172d5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:06.221979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:06.290232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35d35-9de3-4228-88fc-cfec887172d5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:06.325701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928d1b-32ff-4eb0-b9d0-8d6653000d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:06.326325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928d1b-32ff-4eb0-b9d0-8d6653000d71 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:06.326603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928d1b-32ff-4eb0-b9d0-8d6653000d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:06.326900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928d1b-32ff-4eb0-b9d0-8d6653000d71 None admin] PATH_INFO: `/v3/projects/0ec763e623e14b4bb64a516e7d0a00e1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:06.328059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928d1b-32ff-4eb0-b9d0-8d6653000d71 None admin] RBAC: Authorizing `identity:get_project(project_id=0ec763e623e14b4bb64a516e7d0a00e1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:06.329578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928d1b-32ff-4eb0-b9d0-8d6653000d71 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:06.331228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 466/904] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Oct 27 01:13:06 2022] GET /identity/v3/projects/0ec763e623e14b4bb64a516e7d0a00e1 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:06.338447 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9afe1-3b35-4d15-be0c-53498a32a2f1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:06.444875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:06.448812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9afe1-3b35-4d15-be0c-53498a32a2f1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:06.490702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05477c9e-cfe3-4997-b253-cfcdc539c19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:06.491315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05477c9e-cfe3-4997-b253-cfcdc539c19a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:06.491584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05477c9e-cfe3-4997-b253-cfcdc539c19a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:06.491854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05477c9e-cfe3-4997-b253-cfcdc539c19a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:06.492748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05477c9e-cfe3-4997-b253-cfcdc539c19a None admin] RBAC: Adding query filter params (role.id=72129dcc28d546169fd012284e4019ec, scope.project.id=0ec763e623e14b4bb64a516e7d0a00e1, user.id=ca79975feb024fb9bc176447b1dc8507) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:13:06.493052 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05477c9e-cfe3-4997-b253-cfcdc539c19a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:06.494545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05477c9e-cfe3-4997-b253-cfcdc539c19a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:06.500345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 439/905] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:13:06 2022] GET /identity/v3/role_assignments?user.id=ca79975feb024fb9bc176447b1dc8507&scope.project.id=0ec763e623e14b4bb64a516e7d0a00e1&role.id=72129dcc28d546169fd012284e4019ec => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:16.320268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=49 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:13:16.497735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=19 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:01.604819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6715c-0674-4862-96c4-ce054c864774 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:01.605453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6715c-0674-4862-96c4-ce054c864774 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:01.605453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6715c-0674-4862-96c4-ce054c864774 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:01.606865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 467/906] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:01.612768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c66d-e763-4451-b8ca-4d4541930515 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:01.613265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c66d-e763-4451-b8ca-4d4541930515 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:01.613265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c66d-e763-4451-b8ca-4d4541930515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:01.633598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-faa8c66d-e763-4451-b8ca-4d4541930515 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:01.634874 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-faa8c66d-e763-4451-b8ca-4d4541930515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:01.726787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 440/907] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:14:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:14:01.999787 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6715c-0674-4862-96c4-ce054c864774 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:02.120434 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6715c-0674-4862-96c4-ce054c864774 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:02.163672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00dfb8-d067-4ba8-a431-7a31c661a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:02.164316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00dfb8-d067-4ba8-a431-7a31c661a75a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:02.164588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00dfb8-d067-4ba8-a431-7a31c661a75a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:02.164855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00dfb8-d067-4ba8-a431-7a31c661a75a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:02.176476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00dfb8-d067-4ba8-a431-7a31c661a75a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:02.178047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00dfb8-d067-4ba8-a431-7a31c661a75a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ce00dfb8-d067-4ba8-a431-7a31c661a75a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:14:02.197698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:02.199232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:14:02.200533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:14:02.200533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:02.200533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:02.203065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 468/908] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:02.205448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8c66d-e763-4451-b8ca-4d4541930515 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:02.326780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8c66d-e763-4451-b8ca-4d4541930515 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:02.357289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:02.365605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869aac4-ba84-4802-a97f-f38870549137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:02.366271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869aac4-ba84-4802-a97f-f38870549137 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:02.366549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869aac4-ba84-4802-a97f-f38870549137 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:02.366847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869aac4-ba84-4802-a97f-f38870549137 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:02.367512 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869aac4-ba84-4802-a97f-f38870549137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:02.367809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869aac4-ba84-4802-a97f-f38870549137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:02.369179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869aac4-ba84-4802-a97f-f38870549137 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:02.381489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 441/909] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:02.387230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00dfb8-d067-4ba8-a431-7a31c661a75a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:02.445702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:02.501183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00dfb8-d067-4ba8-a431-7a31c661a75a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:02.550734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf388-27f7-4b40-a8ff-ffa22841a88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:02.551355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf388-27f7-4b40-a8ff-ffa22841a88c None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:02.551650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf388-27f7-4b40-a8ff-ffa22841a88c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:02.551910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf388-27f7-4b40-a8ff-ffa22841a88c None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:02.552653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdf388-27f7-4b40-a8ff-ffa22841a88c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:02.554147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdf388-27f7-4b40-a8ff-ffa22841a88c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:02.592844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 469/910] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Oct 27 01:14:02 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:14:04.879220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe5b1-6ec6-4624-9d45-566e45e52656 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:04.879775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe5b1-6ec6-4624-9d45-566e45e52656 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:04.879775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe5b1-6ec6-4624-9d45-566e45e52656 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:04.881152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 442/911] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:04.887776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be18cf-929e-4af3-b4e4-dccb1e20f474 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:04.888221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be18cf-929e-4af3-b4e4-dccb1e20f474 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:04.888331 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be18cf-929e-4af3-b4e4-dccb1e20f474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:04.909456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e5be18cf-929e-4af3-b4e4-dccb1e20f474 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:04.910656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e5be18cf-929e-4af3-b4e4-dccb1e20f474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:04.984615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 470/912] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:14:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:14:05.279937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe5b1-6ec6-4624-9d45-566e45e52656 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:05.412746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe5b1-6ec6-4624-9d45-566e45e52656 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:05.451292 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e1ab8-cd84-4754-aa60-69c529b660b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:05.451939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e1ab8-cd84-4754-aa60-69c529b660b5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:05.452219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e1ab8-cd84-4754-aa60-69c529b660b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:05.452490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e1ab8-cd84-4754-aa60-69c529b660b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:05.467156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e1ab8-cd84-4754-aa60-69c529b660b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ba7e1ab8-cd84-4754-aa60-69c529b660b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:14:05.473716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:05.475336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:05.476174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 443/913] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:14:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:14:05.481611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be18cf-929e-4af3-b4e4-dccb1e20f474 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:05.537838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:05.609177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be18cf-929e-4af3-b4e4-dccb1e20f474 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:05.647931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16800e-7714-4bc7-89e6-d309fd4fa28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:05.648566 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16800e-7714-4bc7-89e6-d309fd4fa28c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:05.648842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16800e-7714-4bc7-89e6-d309fd4fa28c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:05.649114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16800e-7714-4bc7-89e6-d309fd4fa28c None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:05.649807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16800e-7714-4bc7-89e6-d309fd4fa28c None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:05.650124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16800e-7714-4bc7-89e6-d309fd4fa28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:05.651491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16800e-7714-4bc7-89e6-d309fd4fa28c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:05.659748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 471/914] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:14:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:14:05.665856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e1ab8-cd84-4754-aa60-69c529b660b5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:05.721652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:05.780963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e1ab8-cd84-4754-aa60-69c529b660b5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:05.825126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af8b2f-41c9-4dda-8c32-cb977fb22006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:05.825319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af8b2f-41c9-4dda-8c32-cb977fb22006 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:05.825613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af8b2f-41c9-4dda-8c32-cb977fb22006 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:05.825886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af8b2f-41c9-4dda-8c32-cb977fb22006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:05.840392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af8b2f-41c9-4dda-8c32-cb977fb22006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:05.842036 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af8b2f-41c9-4dda-8c32-cb977fb22006 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-72af8b2f-41c9-4dda-8c32-cb977fb22006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:14:05.858700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:05.859708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:14:05.860649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:14:05.860649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:05.860649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:05.860649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 444/915] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:05.865999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16800e-7714-4bc7-89e6-d309fd4fa28c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:05.980310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:05.983668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16800e-7714-4bc7-89e6-d309fd4fa28c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:06.020175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b609fc2-eb9d-4bd1-bf3e-e5af94305bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:06.020962 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b609fc2-eb9d-4bd1-bf3e-e5af94305bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:06.021108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b609fc2-eb9d-4bd1-bf3e-e5af94305bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:06.021375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b609fc2-eb9d-4bd1-bf3e-e5af94305bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:06.022341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b609fc2-eb9d-4bd1-bf3e-e5af94305bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:06.022726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b609fc2-eb9d-4bd1-bf3e-e5af94305bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:06.024291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b609fc2-eb9d-4bd1-bf3e-e5af94305bf0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:06.042800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 472/916] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:06.045046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af8b2f-41c9-4dda-8c32-cb977fb22006 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:06.162571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af8b2f-41c9-4dda-8c32-cb977fb22006 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:06.164209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:06.200684 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bedd19-c00f-45b3-a996-2e1f604bb6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:06.201498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bedd19-c00f-45b3-a996-2e1f604bb6ac None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:06.201810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bedd19-c00f-45b3-a996-2e1f604bb6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:06.202173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bedd19-c00f-45b3-a996-2e1f604bb6ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:06.211504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bedd19-c00f-45b3-a996-2e1f604bb6ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:06.213014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bedd19-c00f-45b3-a996-2e1f604bb6ac None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-74bedd19-c00f-45b3-a996-2e1f604bb6ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:14:06.225112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:06.226503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:06.227477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 445/917] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:14:06.237261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b609fc2-eb9d-4bd1-bf3e-e5af94305bf0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:06.354623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b609fc2-eb9d-4bd1-bf3e-e5af94305bf0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:06.400668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311885b-122f-4639-a1e7-4d7cfc6fd05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:06.401326 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311885b-122f-4639-a1e7-4d7cfc6fd05a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:06.401611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311885b-122f-4639-a1e7-4d7cfc6fd05a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:06.401919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311885b-122f-4639-a1e7-4d7cfc6fd05a None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:06.402680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311885b-122f-4639-a1e7-4d7cfc6fd05a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:06.403107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311885b-122f-4639-a1e7-4d7cfc6fd05a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:06.404631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311885b-122f-4639-a1e7-4d7cfc6fd05a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:06.425302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 473/918] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Oct 27 01:14:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:06.431817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bedd19-c00f-45b3-a996-2e1f604bb6ac None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:06.567307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bedd19-c00f-45b3-a996-2e1f604bb6ac None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:06.606192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cae77a-002e-4e29-862c-81ebd7cfcff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:06.606998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cae77a-002e-4e29-862c-81ebd7cfcff0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:06.607458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cae77a-002e-4e29-862c-81ebd7cfcff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:06.607644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cae77a-002e-4e29-862c-81ebd7cfcff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:06.624041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cae77a-002e-4e29-862c-81ebd7cfcff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:06.626642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cae77a-002e-4e29-862c-81ebd7cfcff0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-50cae77a-002e-4e29-862c-81ebd7cfcff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:14:06.645941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:06.649552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:14:06.650489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:14:06.650489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:06.650489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:06.650489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 446/919] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:06.653236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311885b-122f-4639-a1e7-4d7cfc6fd05a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:06.672528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:06.761763 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311885b-122f-4639-a1e7-4d7cfc6fd05a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:06.799764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9088c61-f32a-43f9-8567-e4821eba205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:06.800381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9088c61-f32a-43f9-8567-e4821eba205f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:06.800659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9088c61-f32a-43f9-8567-e4821eba205f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:06.800932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9088c61-f32a-43f9-8567-e4821eba205f None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:06.801568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9088c61-f32a-43f9-8567-e4821eba205f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:06.801868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9088c61-f32a-43f9-8567-e4821eba205f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:06.803255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9088c61-f32a-43f9-8567-e4821eba205f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:06.819506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 474/920] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:06.824116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cae77a-002e-4e29-862c-81ebd7cfcff0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:06.852268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:06.955401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cae77a-002e-4e29-862c-81ebd7cfcff0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:06.993982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af4d3-c020-4ba7-aeb8-4184e5e358e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:06.995057 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af4d3-c020-4ba7-aeb8-4184e5e358e0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:06.995358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af4d3-c020-4ba7-aeb8-4184e5e358e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:06.995652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af4d3-c020-4ba7-aeb8-4184e5e358e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:07.003142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253af4d3-c020-4ba7-aeb8-4184e5e358e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:07.004689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253af4d3-c020-4ba7-aeb8-4184e5e358e0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-253af4d3-c020-4ba7-aeb8-4184e5e358e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:14:07.018379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:07.019562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:07.020665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:14:07.020665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:14:07.020665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:14:07.020665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:14:07.020665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:14:07.020665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:14:07.020665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:14:07.020665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:07.020665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 447/921] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:07.025555 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9088c61-f32a-43f9-8567-e4821eba205f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:07.110471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:07.140254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9088c61-f32a-43f9-8567-e4821eba205f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:07.177645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262d232-51cd-47b7-a30e-022134a6a02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:07.178429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d232-51cd-47b7-a30e-022134a6a02b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:07.178836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d232-51cd-47b7-a30e-022134a6a02b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:07.179207 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d232-51cd-47b7-a30e-022134a6a02b None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:07.180011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262d232-51cd-47b7-a30e-022134a6a02b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:07.180438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262d232-51cd-47b7-a30e-022134a6a02b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:07.181956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262d232-51cd-47b7-a30e-022134a6a02b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:07.196129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 475/922] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:14:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:07.202034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af4d3-c020-4ba7-aeb8-4184e5e358e0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:07.286030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:07.316770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af4d3-c020-4ba7-aeb8-4184e5e358e0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:07.358018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406774cc-4302-44ea-98b4-cd33842c2846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:07.358864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406774cc-4302-44ea-98b4-cd33842c2846 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:07.359240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406774cc-4302-44ea-98b4-cd33842c2846 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:07.359773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406774cc-4302-44ea-98b4-cd33842c2846 None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/bc32363c074f4418964ea46068a28831/roles/70b64fc972514149806cf9aeb00c7ce1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:07.377170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406774cc-4302-44ea-98b4-cd33842c2846 None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=bc32363c074f4418964ea46068a28831, role_id=70b64fc972514149806cf9aeb00c7ce1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:07.379210 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406774cc-4302-44ea-98b4-cd33842c2846 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:07.394429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 448/923] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:14:07 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/bc32363c074f4418964ea46068a28831/roles/70b64fc972514149806cf9aeb00c7ce1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:14:09.534410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed75e4d-1ead-4c48-8754-9c0523ed9d1f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:09.535004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed75e4d-1ead-4c48-8754-9c0523ed9d1f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:09.535004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed75e4d-1ead-4c48-8754-9c0523ed9d1f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:09.536356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 476/924] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:09.541840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de753b-7805-4ef2-b65f-b428214d5fcf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:09.542304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de753b-7805-4ef2-b65f-b428214d5fcf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:09.542405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de753b-7805-4ef2-b65f-b428214d5fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:09.562186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-90de753b-7805-4ef2-b65f-b428214d5fcf None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:09.563448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-90de753b-7805-4ef2-b65f-b428214d5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:09.634253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 449/925] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:14:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:14:09.900654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed75e4d-1ead-4c48-8754-9c0523ed9d1f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:10.011195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed75e4d-1ead-4c48-8754-9c0523ed9d1f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:10.046036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50442-56ee-4159-9ee2-ce3d573f5c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:10.046670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50442-56ee-4159-9ee2-ce3d573f5c6e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:10.046968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50442-56ee-4159-9ee2-ce3d573f5c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:10.047237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50442-56ee-4159-9ee2-ce3d573f5c6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:10.053763 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:10.057771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd50442-56ee-4159-9ee2-ce3d573f5c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-0fd50442-56ee-4159-9ee2-ce3d573f5c6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:14:10.062751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:10.063657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:10.064505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 477/926] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Oct 27 01:14:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:10.070291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de753b-7805-4ef2-b65f-b428214d5fcf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:10.129584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:10.178405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de753b-7805-4ef2-b65f-b428214d5fcf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:10.214333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f3ffc-f697-45e7-b745-b2ee78deb0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:10.214975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f3ffc-f697-45e7-b745-b2ee78deb0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:10.215319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f3ffc-f697-45e7-b745-b2ee78deb0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:10.215550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f3ffc-f697-45e7-b745-b2ee78deb0b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:10.216225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f3ffc-f697-45e7-b745-b2ee78deb0b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:10.216527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f3ffc-f697-45e7-b745-b2ee78deb0b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:10.217899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f3ffc-f697-45e7-b745-b2ee78deb0b8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:10.226642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 450/927] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Oct 27 01:14:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:10.234229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50442-56ee-4159-9ee2-ce3d573f5c6e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:10.340863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50442-56ee-4159-9ee2-ce3d573f5c6e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:10.377312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726b3b-9260-4201-a647-918195e8845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:10.377954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726b3b-9260-4201-a647-918195e8845a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:10.378230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726b3b-9260-4201-a647-918195e8845a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:10.378506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726b3b-9260-4201-a647-918195e8845a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:10.389037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726b3b-9260-4201-a647-918195e8845a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:10.390414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726b3b-9260-4201-a647-918195e8845a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-07726b3b-9260-4201-a647-918195e8845a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:14:10.405416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:10.411460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:14:10.412621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:14:10.412621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:10.412621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:10.412621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 478/928] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:10.412904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f3ffc-f697-45e7-b745-b2ee78deb0b8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:10.526871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f3ffc-f697-45e7-b745-b2ee78deb0b8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:10.544373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:10.563811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bfddc-a6da-464b-8980-ec0da3eb38e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:10.564440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bfddc-a6da-464b-8980-ec0da3eb38e2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:10.564721 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bfddc-a6da-464b-8980-ec0da3eb38e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:10.564992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bfddc-a6da-464b-8980-ec0da3eb38e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:10.565644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bfddc-a6da-464b-8980-ec0da3eb38e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:10.565949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bfddc-a6da-464b-8980-ec0da3eb38e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:10.567338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bfddc-a6da-464b-8980-ec0da3eb38e2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:10.581765 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 451/929] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:14:10.587726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726b3b-9260-4201-a647-918195e8845a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:10.639712 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:10.690902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726b3b-9260-4201-a647-918195e8845a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:10.726953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfeef-5790-46ad-a066-5e8f29ff8226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:10.727600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfeef-5790-46ad-a066-5e8f29ff8226 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:10.727881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfeef-5790-46ad-a066-5e8f29ff8226 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:10.728151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfeef-5790-46ad-a066-5e8f29ff8226 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:10.735674 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcfeef-5790-46ad-a066-5e8f29ff8226 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:10.737101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcfeef-5790-46ad-a066-5e8f29ff8226 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-5afcfeef-5790-46ad-a066-5e8f29ff8226 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:14:10.748151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:10.749301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:10.750247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 479/930] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:10.755223 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bfddc-a6da-464b-8980-ec0da3eb38e2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:10.864831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bfddc-a6da-464b-8980-ec0da3eb38e2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:10.902562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12438113-8cb1-4f2f-bf7e-1c7d29a9693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:10.903132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12438113-8cb1-4f2f-bf7e-1c7d29a9693c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:10.903418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12438113-8cb1-4f2f-bf7e-1c7d29a9693c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:10.903752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12438113-8cb1-4f2f-bf7e-1c7d29a9693c None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:10.904607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12438113-8cb1-4f2f-bf7e-1c7d29a9693c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:10.904914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12438113-8cb1-4f2f-bf7e-1c7d29a9693c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:10.906742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12438113-8cb1-4f2f-bf7e-1c7d29a9693c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:10.925450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 452/931] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Oct 27 01:14:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:10.931911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfeef-5790-46ad-a066-5e8f29ff8226 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:11.043864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfeef-5790-46ad-a066-5e8f29ff8226 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:11.056291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:11.082468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec401d-8132-421b-8482-0e629eab06bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:11.083137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec401d-8132-421b-8482-0e629eab06bb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:11.083442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec401d-8132-421b-8482-0e629eab06bb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:11.083682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec401d-8132-421b-8482-0e629eab06bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:11.158027 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec401d-8132-421b-8482-0e629eab06bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:11.159435 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec401d-8132-421b-8482-0e629eab06bb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:11.270538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 480/932] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:14:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:14:11.276323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12438113-8cb1-4f2f-bf7e-1c7d29a9693c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:11.315031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:11.388570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12438113-8cb1-4f2f-bf7e-1c7d29a9693c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:11.427972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d42ec-59df-4261-986f-2a9c7c9966cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:11.428465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d42ec-59df-4261-986f-2a9c7c9966cc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:11.428742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d42ec-59df-4261-986f-2a9c7c9966cc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:11.429017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d42ec-59df-4261-986f-2a9c7c9966cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:11.439115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d42ec-59df-4261-986f-2a9c7c9966cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:11.440553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d42ec-59df-4261-986f-2a9c7c9966cc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-221d42ec-59df-4261-986f-2a9c7c9966cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:14:11.456042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:11.457213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:14:11.462872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:14:11.462872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:11.462872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:11.462872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 453/933] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:11.463268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec401d-8132-421b-8482-0e629eab06bb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:11.476566 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:11.576710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec401d-8132-421b-8482-0e629eab06bb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:11.616721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468460dd-2f84-4f1c-a2a3-6b96fc213960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:11.617453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468460dd-2f84-4f1c-a2a3-6b96fc213960 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:11.617882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468460dd-2f84-4f1c-a2a3-6b96fc213960 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:11.618275 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468460dd-2f84-4f1c-a2a3-6b96fc213960 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:11.619196 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468460dd-2f84-4f1c-a2a3-6b96fc213960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:11.619599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468460dd-2f84-4f1c-a2a3-6b96fc213960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:11.621560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468460dd-2f84-4f1c-a2a3-6b96fc213960 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:11.636011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 481/934] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:11.642802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d42ec-59df-4261-986f-2a9c7c9966cc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:11.737303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:11.756840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d42ec-59df-4261-986f-2a9c7c9966cc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:11.796074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb662681-2e35-4daf-b691-651931f3f6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:11.796683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb662681-2e35-4daf-b691-651931f3f6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:11.796994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb662681-2e35-4daf-b691-651931f3f6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:11.797260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb662681-2e35-4daf-b691-651931f3f6c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:11.804172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb662681-2e35-4daf-b691-651931f3f6c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:11.805690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb662681-2e35-4daf-b691-651931f3f6c1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-cb662681-2e35-4daf-b691-651931f3f6c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:14:11.818474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:11.819450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:11.820864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:14:11.820864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:14:11.820864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:14:11.820864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:14:11.820864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:14:11.820864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:14:11.820864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:14:11.820864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:11.820864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 454/935] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:14:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:11.827050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468460dd-2f84-4f1c-a2a3-6b96fc213960 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:11.905919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:11.943203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468460dd-2f84-4f1c-a2a3-6b96fc213960 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:11.982222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efbee8-617a-496f-b035-479c8f2d4f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:11.982862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efbee8-617a-496f-b035-479c8f2d4f5f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:11.983132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efbee8-617a-496f-b035-479c8f2d4f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:11.983400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efbee8-617a-496f-b035-479c8f2d4f5f None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:11.984090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efbee8-617a-496f-b035-479c8f2d4f5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:11.984408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efbee8-617a-496f-b035-479c8f2d4f5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:11.985803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efbee8-617a-496f-b035-479c8f2d4f5f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:11.998009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 482/936] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:12.004428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb662681-2e35-4daf-b691-651931f3f6c1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:12.110816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb662681-2e35-4daf-b691-651931f3f6c1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:12.146686 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9246e49-8bfb-41ea-8d6e-5f78d2b4b7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:12.147280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9246e49-8bfb-41ea-8d6e-5f78d2b4b7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:12.147556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9246e49-8bfb-41ea-8d6e-5f78d2b4b7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:12.147865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9246e49-8bfb-41ea-8d6e-5f78d2b4b7a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:12.148547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9246e49-8bfb-41ea-8d6e-5f78d2b4b7a2 None admin] RBAC: Adding query filter params (role.id=70b64fc972514149806cf9aeb00c7ce1, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=bc32363c074f4418964ea46068a28831) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:12.148857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9246e49-8bfb-41ea-8d6e-5f78d2b4b7a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:12.150298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9246e49-8bfb-41ea-8d6e-5f78d2b4b7a2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:12.156835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 455/937] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:14:12 2022] GET /identity/v3/role_assignments?user.id=bc32363c074f4418964ea46068a28831&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=70b64fc972514149806cf9aeb00c7ce1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:14.433468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb95d-a198-4fed-8997-4da55c9bd1bd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:14.434072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb95d-a198-4fed-8997-4da55c9bd1bd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:14.434072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb95d-a198-4fed-8997-4da55c9bd1bd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:14.435462 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 483/938] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:14.440758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ec37-e43f-4794-8703-3cf678a592b6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:14.441218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ec37-e43f-4794-8703-3cf678a592b6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:14.441312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ec37-e43f-4794-8703-3cf678a592b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:14.460849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2336ec37-e43f-4794-8703-3cf678a592b6 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:14.462049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2336ec37-e43f-4794-8703-3cf678a592b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:14.465417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:14.542990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 456/939] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:14:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:14:14.826041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb95d-a198-4fed-8997-4da55c9bd1bd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:14.939378 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb95d-a198-4fed-8997-4da55c9bd1bd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:14.970956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:14.977179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92df85-9663-49c5-88af-99b63726ed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:14.977861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92df85-9663-49c5-88af-99b63726ed25 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:14.978177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92df85-9663-49c5-88af-99b63726ed25 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:14.978449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92df85-9663-49c5-88af-99b63726ed25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:14.989139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92df85-9663-49c5-88af-99b63726ed25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-fc92df85-9663-49c5-88af-99b63726ed25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:14:14.994884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:14.996308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:14.997669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 484/940] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:15.002317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ec37-e43f-4794-8703-3cf678a592b6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:15.104344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ec37-e43f-4794-8703-3cf678a592b6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:15.143199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a551-8932-42a5-8faf-ea76b4aee3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:15.143818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a551-8932-42a5-8faf-ea76b4aee3ce None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:15.144095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a551-8932-42a5-8faf-ea76b4aee3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:15.144367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a551-8932-42a5-8faf-ea76b4aee3ce None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:15.145033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a551-8932-42a5-8faf-ea76b4aee3ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:15.145336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a551-8932-42a5-8faf-ea76b4aee3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:15.146912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a551-8932-42a5-8faf-ea76b4aee3ce None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:15.156604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 457/941] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:15.163015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92df85-9663-49c5-88af-99b63726ed25 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:15.271239 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92df85-9663-49c5-88af-99b63726ed25 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:15.309423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a86c30-0ad4-4f07-97a7-4ebf73e5242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:15.310106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a86c30-0ad4-4f07-97a7-4ebf73e5242b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:15.310368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a86c30-0ad4-4f07-97a7-4ebf73e5242b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:15.310736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a86c30-0ad4-4f07-97a7-4ebf73e5242b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:15.322819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a86c30-0ad4-4f07-97a7-4ebf73e5242b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:15.324805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a86c30-0ad4-4f07-97a7-4ebf73e5242b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-22a86c30-0ad4-4f07-97a7-4ebf73e5242b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:14:15.340016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:15.345960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:14:15.347138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:14:15.347138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:15.347138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:15.347138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 485/942] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:14:15.347414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a551-8932-42a5-8faf-ea76b4aee3ce None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:15.350165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:15.452436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a551-8932-42a5-8faf-ea76b4aee3ce None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:15.488984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72633c-258d-46b1-aae1-1a3f39e69fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:15.489607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72633c-258d-46b1-aae1-1a3f39e69fab None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:15.489888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72633c-258d-46b1-aae1-1a3f39e69fab None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:15.490206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72633c-258d-46b1-aae1-1a3f39e69fab None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:15.491081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72633c-258d-46b1-aae1-1a3f39e69fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:15.491391 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72633c-258d-46b1-aae1-1a3f39e69fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:15.493116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72633c-258d-46b1-aae1-1a3f39e69fab None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:15.514101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 458/943] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:15.515561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a86c30-0ad4-4f07-97a7-4ebf73e5242b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:15.566845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:15.633669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a86c30-0ad4-4f07-97a7-4ebf73e5242b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:15.671300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d15ae-ef53-4384-9d9e-c7dd6bc994a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:15.671946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d15ae-ef53-4384-9d9e-c7dd6bc994a1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:15.672224 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d15ae-ef53-4384-9d9e-c7dd6bc994a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:15.672502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d15ae-ef53-4384-9d9e-c7dd6bc994a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:15.680658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d15ae-ef53-4384-9d9e-c7dd6bc994a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:15.682266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d15ae-ef53-4384-9d9e-c7dd6bc994a1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-6b2d15ae-ef53-4384-9d9e-c7dd6bc994a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:14:15.695525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:15.696717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:15.704089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 486/944] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:15.704679 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72633c-258d-46b1-aae1-1a3f39e69fab None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:15.773786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:15.818373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72633c-258d-46b1-aae1-1a3f39e69fab None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:15.864482 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d8cdb-db95-447c-ba22-742a333fabf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:15.865133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d8cdb-db95-447c-ba22-742a333fabf2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:15.865448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d8cdb-db95-447c-ba22-742a333fabf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:15.865753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d8cdb-db95-447c-ba22-742a333fabf2 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:15.866563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d8cdb-db95-447c-ba22-742a333fabf2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:15.867002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d8cdb-db95-447c-ba22-742a333fabf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:15.868722 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d8cdb-db95-447c-ba22-742a333fabf2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:15.894796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 459/945] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Oct 27 01:14:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:14:15.896124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d15ae-ef53-4384-9d9e-c7dd6bc994a1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:16.004524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d15ae-ef53-4384-9d9e-c7dd6bc994a1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:16.005925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:16.044332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08144b-bef6-417e-ad17-4c001cffaa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:16.045119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08144b-bef6-417e-ad17-4c001cffaa56 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:16.045476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08144b-bef6-417e-ad17-4c001cffaa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:16.045754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08144b-bef6-417e-ad17-4c001cffaa56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:16.056102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08144b-bef6-417e-ad17-4c001cffaa56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:16.057522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08144b-bef6-417e-ad17-4c001cffaa56 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-3b08144b-bef6-417e-ad17-4c001cffaa56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:14:16.072836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:16.073841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:14:16.074885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:14:16.074885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:16.074885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:16.074885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 487/946] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:16.083208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d8cdb-db95-447c-ba22-742a333fabf2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:16.198420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d8cdb-db95-447c-ba22-742a333fabf2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:16.219268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:16.236043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14357-ecf0-4564-9a47-06912a57cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:16.236655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14357-ecf0-4564-9a47-06912a57cedc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:16.236932 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14357-ecf0-4564-9a47-06912a57cedc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:16.237319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14357-ecf0-4564-9a47-06912a57cedc None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:16.238207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14357-ecf0-4564-9a47-06912a57cedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:16.238596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14357-ecf0-4564-9a47-06912a57cedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:16.240503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14357-ecf0-4564-9a47-06912a57cedc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:16.252541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 460/947] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:16.258955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08144b-bef6-417e-ad17-4c001cffaa56 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:16.372993 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08144b-bef6-417e-ad17-4c001cffaa56 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:16.409739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482c350-c89d-4383-ba5c-88e98e854398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:16.410517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482c350-c89d-4383-ba5c-88e98e854398 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:16.410885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482c350-c89d-4383-ba5c-88e98e854398 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:16.411226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482c350-c89d-4383-ba5c-88e98e854398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:16.418811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482c350-c89d-4383-ba5c-88e98e854398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:16.420351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482c350-c89d-4383-ba5c-88e98e854398 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-0482c350-c89d-4383-ba5c-88e98e854398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:14:16.432109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:16.433191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:16.434192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:14:16.434192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:14:16.434192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:14:16.434192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:14:16.434192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:14:16.434192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:14:16.434192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:14:16.434192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:16.434192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 488/948] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:16.439876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14357-ecf0-4564-9a47-06912a57cedc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:16.553843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14357-ecf0-4564-9a47-06912a57cedc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:16.589789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc3368-a2bc-4bfb-ba6e-d5e407c8a009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:16.590486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc3368-a2bc-4bfb-ba6e-d5e407c8a009 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:16.590790 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc3368-a2bc-4bfb-ba6e-d5e407c8a009 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:16.591068 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc3368-a2bc-4bfb-ba6e-d5e407c8a009 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:16.591824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc3368-a2bc-4bfb-ba6e-d5e407c8a009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:16.592154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc3368-a2bc-4bfb-ba6e-d5e407c8a009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:16.593840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc3368-a2bc-4bfb-ba6e-d5e407c8a009 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:16.607682 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 461/949] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:14:16.614693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482c350-c89d-4383-ba5c-88e98e854398 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:16.632315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:16.728786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482c350-c89d-4383-ba5c-88e98e854398 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:16.768776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fcfad-ff8b-4863-98db-f228f938d129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:16.769462 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fcfad-ff8b-4863-98db-f228f938d129 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:16.769743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fcfad-ff8b-4863-98db-f228f938d129 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:16.770019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fcfad-ff8b-4863-98db-f228f938d129 None admin] PATH_INFO: `/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/bc32363c074f4418964ea46068a28831/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:16.771946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fcfad-ff8b-4863-98db-f228f938d129 None admin] RBAC: Authorizing `identity:create_grant(project_id=84bb5840092d4782812e0d0bdb4d3cb0, user_id=bc32363c074f4418964ea46068a28831, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:16.773384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fcfad-ff8b-4863-98db-f228f938d129 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:16.789861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 489/950] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Oct 27 01:14:16 2022] PUT /identity/v3/projects/84bb5840092d4782812e0d0bdb4d3cb0/users/bc32363c074f4418964ea46068a28831/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:14:19.236966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f78d1-a8da-4d01-a0d4-e5dc26fe3e3d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:19.237557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f78d1-a8da-4d01-a0d4-e5dc26fe3e3d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:19.237557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f78d1-a8da-4d01-a0d4-e5dc26fe3e3d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:19.239191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 462/951] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:19.245651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041633a-c781-478c-9f61-340918506272 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:19.246235 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041633a-c781-478c-9f61-340918506272 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:19.246347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041633a-c781-478c-9f61-340918506272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:19.267323 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0041633a-c781-478c-9f61-340918506272 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:19.268781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0041633a-c781-478c-9f61-340918506272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:19.341876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 490/952] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:14:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:14:19.662898 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f78d1-a8da-4d01-a0d4-e5dc26fe3e3d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:19.712306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:19.775278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f78d1-a8da-4d01-a0d4-e5dc26fe3e3d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:19.811500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f629c-8647-4c7d-ba10-a2db5706b62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:19.812147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f629c-8647-4c7d-ba10-a2db5706b62c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:19.812443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f629c-8647-4c7d-ba10-a2db5706b62c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:19.812690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f629c-8647-4c7d-ba10-a2db5706b62c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:19.825374 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f629c-8647-4c7d-ba10-a2db5706b62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-158f629c-8647-4c7d-ba10-a2db5706b62c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 01:14:19.830881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:19.831834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:19.832699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 463/953] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Oct 27 01:14:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:19.838132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041633a-c781-478c-9f61-340918506272 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:19.841515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:19.947023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041633a-c781-478c-9f61-340918506272 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:19.984227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2a576-0e65-4597-990f-dbd5dc917889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:19.984987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2a576-0e65-4597-990f-dbd5dc917889 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:19.985264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2a576-0e65-4597-990f-dbd5dc917889 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:19.985533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2a576-0e65-4597-990f-dbd5dc917889 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:19.986277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2a576-0e65-4597-990f-dbd5dc917889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:19.986618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2a576-0e65-4597-990f-dbd5dc917889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:19.988461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2a576-0e65-4597-990f-dbd5dc917889 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:19.998157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 491/954] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Oct 27 01:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:20.004147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f629c-8647-4c7d-ba10-a2db5706b62c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:20.108701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:20.112130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f629c-8647-4c7d-ba10-a2db5706b62c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:20.149937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03bf3e-ece9-4ade-ab02-dcb9a0ae1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:20.150587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03bf3e-ece9-4ade-ab02-dcb9a0ae1774 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:20.150903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03bf3e-ece9-4ade-ab02-dcb9a0ae1774 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:20.151180 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03bf3e-ece9-4ade-ab02-dcb9a0ae1774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:20.161828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03bf3e-ece9-4ade-ab02-dcb9a0ae1774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:20.163338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03bf3e-ece9-4ade-ab02-dcb9a0ae1774 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7c03bf3e-ece9-4ade-ab02-dcb9a0ae1774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:14:20.178933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:20.180111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:14:20.181157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:14:20.181157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:20.181157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:20.181157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 464/955] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:20.186184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2a576-0e65-4597-990f-dbd5dc917889 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:20.256101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:20.292826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2a576-0e65-4597-990f-dbd5dc917889 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:20.326481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3f0d8-6b1f-42f7-b1b8-a85676edc458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:20.327128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3f0d8-6b1f-42f7-b1b8-a85676edc458 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:20.327405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3f0d8-6b1f-42f7-b1b8-a85676edc458 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:20.327904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3f0d8-6b1f-42f7-b1b8-a85676edc458 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:20.328317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3f0d8-6b1f-42f7-b1b8-a85676edc458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:20.328619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3f0d8-6b1f-42f7-b1b8-a85676edc458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:20.329967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3f0d8-6b1f-42f7-b1b8-a85676edc458 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:20.341930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 492/956] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:20.347848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03bf3e-ece9-4ade-ab02-dcb9a0ae1774 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:20.458417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03bf3e-ece9-4ade-ab02-dcb9a0ae1774 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:20.495822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeaa47-40cf-47f4-a642-2c563559eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:20.496561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeaa47-40cf-47f4-a642-2c563559eef4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:20.496867 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeaa47-40cf-47f4-a642-2c563559eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:20.497062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeaa47-40cf-47f4-a642-2c563559eef4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:20.505222 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faeaa47-40cf-47f4-a642-2c563559eef4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:20.506742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faeaa47-40cf-47f4-a642-2c563559eef4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8faeaa47-40cf-47f4-a642-2c563559eef4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 01:14:20.519555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:20.520583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:20.521642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 465/957] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:20.527697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3f0d8-6b1f-42f7-b1b8-a85676edc458 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:20.640411 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3f0d8-6b1f-42f7-b1b8-a85676edc458 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:20.667362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:20.676051 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8d649-8386-4149-a919-109c63a7152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:20.676669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8d649-8386-4149-a919-109c63a7152b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:20.676949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8d649-8386-4149-a919-109c63a7152b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:20.677217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8d649-8386-4149-a919-109c63a7152b None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:20.677944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8d649-8386-4149-a919-109c63a7152b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:20.678249 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8d649-8386-4149-a919-109c63a7152b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:20.679707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8d649-8386-4149-a919-109c63a7152b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:20.697472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 493/958] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Oct 27 01:14:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:20.703843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeaa47-40cf-47f4-a642-2c563559eef4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:20.720876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:20.808326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeaa47-40cf-47f4-a642-2c563559eef4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:20.842653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee56b33-987e-4076-8b6b-73333cda2a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:20.843316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee56b33-987e-4076-8b6b-73333cda2a37 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:20.843606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee56b33-987e-4076-8b6b-73333cda2a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:20.843851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee56b33-987e-4076-8b6b-73333cda2a37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:20.915751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee56b33-987e-4076-8b6b-73333cda2a37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:20.916628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee56b33-987e-4076-8b6b-73333cda2a37 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:20.931789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:21.026492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 466/959] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Oct 27 01:14:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 01:14:21.032634 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8d649-8386-4149-a919-109c63a7152b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:21.136851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8d649-8386-4149-a919-109c63a7152b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:21.171654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9476d-672b-44a0-b731-26f7e0eca638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:21.172300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9476d-672b-44a0-b731-26f7e0eca638 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:21.172574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9476d-672b-44a0-b731-26f7e0eca638 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:21.172840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9476d-672b-44a0-b731-26f7e0eca638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:21.183254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9476d-672b-44a0-b731-26f7e0eca638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:21.184816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9476d-672b-44a0-b731-26f7e0eca638 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-70f9476d-672b-44a0-b731-26f7e0eca638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 01:14:21.199157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:21.200604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 01:14:21.201709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 01:14:21.201709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:14:21.201709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:21.201709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 494/960] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:14:21.206234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee56b33-987e-4076-8b6b-73333cda2a37 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:21.309104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee56b33-987e-4076-8b6b-73333cda2a37 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:21.326875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:21.348377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10784484-b059-41b7-93ed-097fdf8f2b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:21.349115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784484-b059-41b7-93ed-097fdf8f2b6c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:21.349334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784484-b059-41b7-93ed-097fdf8f2b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:21.349521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784484-b059-41b7-93ed-097fdf8f2b6c None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:21.350163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784484-b059-41b7-93ed-097fdf8f2b6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:21.350465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784484-b059-41b7-93ed-097fdf8f2b6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:21.351871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784484-b059-41b7-93ed-097fdf8f2b6c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:21.363957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 467/961] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Oct 27 01:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:21.369944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9476d-672b-44a0-b731-26f7e0eca638 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:21.408512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:21.477936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9476d-672b-44a0-b731-26f7e0eca638 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:21.520436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e927f-8117-4dbb-95aa-79dd258f3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:21.521178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e927f-8117-4dbb-95aa-79dd258f3c56 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:21.521475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e927f-8117-4dbb-95aa-79dd258f3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:21.521810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e927f-8117-4dbb-95aa-79dd258f3c56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:21.530007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e927f-8117-4dbb-95aa-79dd258f3c56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:21.531908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e927f-8117-4dbb-95aa-79dd258f3c56 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ae2e927f-8117-4dbb-95aa-79dd258f3c56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 01:14:21.546754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:21.547964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:21.548882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 01:14:21.548882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 01:14:21.548882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 01:14:21.548882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 01:14:21.548882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 01:14:21.548882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 01:14:21.548882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:14:21.548882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Oct 27 01:14:21.548882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 495/962] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Oct 27 01:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:21.554344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10784484-b059-41b7-93ed-097fdf8f2b6c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:21.665479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10784484-b059-41b7-93ed-097fdf8f2b6c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:21.704511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35197-9d69-483e-ba0e-5dfce770f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:21.705420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35197-9d69-483e-ba0e-5dfce770f888 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:21.705745 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35197-9d69-483e-ba0e-5dfce770f888 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:21.706116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35197-9d69-483e-ba0e-5dfce770f888 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:21.706974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35197-9d69-483e-ba0e-5dfce770f888 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:21.707349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35197-9d69-483e-ba0e-5dfce770f888 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:21.710939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35197-9d69-483e-ba0e-5dfce770f888 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:21.723425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 468/963] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Oct 27 01:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:21.729675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e927f-8117-4dbb-95aa-79dd258f3c56 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:21.837302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:21.844265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e927f-8117-4dbb-95aa-79dd258f3c56 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:21.881099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526e34a-474d-40dc-9411-4a95ae01fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:21.881714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526e34a-474d-40dc-9411-4a95ae01fb6e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:21.881992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526e34a-474d-40dc-9411-4a95ae01fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:21.882269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526e34a-474d-40dc-9411-4a95ae01fb6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:21.883064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526e34a-474d-40dc-9411-4a95ae01fb6e None admin] RBAC: Adding query filter params (role.id=72129dcc28d546169fd012284e4019ec, scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0, user.id=bc32363c074f4418964ea46068a28831) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:21.883370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526e34a-474d-40dc-9411-4a95ae01fb6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:21.884791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526e34a-474d-40dc-9411-4a95ae01fb6e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:21.891408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 496/964] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Oct 27 01:14:21 2022] GET /identity/v3/role_assignments?user.id=bc32363c074f4418964ea46068a28831&scope.project.id=84bb5840092d4782812e0d0bdb4d3cb0&role.id=72129dcc28d546169fd012284e4019ec => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:24.014254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552061-8468-43df-a343-19325d59a4ca None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:24.015192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552061-8468-43df-a343-19325d59a4ca None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:24.015192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552061-8468-43df-a343-19325d59a4ca None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:24.017302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 469/965] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:14:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:24.023681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457db8c-ad45-4ea8-aae8-7f6778576b74 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:24.024467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457db8c-ad45-4ea8-aae8-7f6778576b74 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:24.024624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457db8c-ad45-4ea8-aae8-7f6778576b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:24.045470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5457db8c-ad45-4ea8-aae8-7f6778576b74 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:24.046672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5457db8c-ad45-4ea8-aae8-7f6778576b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:24.114628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 497/966] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:14:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:14:24.377925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552061-8468-43df-a343-19325d59a4ca None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:24.414575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:24.495749 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552061-8468-43df-a343-19325d59a4ca None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:24.534899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199f23d-3579-450e-a171-99c4ba71565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:24.535632 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199f23d-3579-450e-a171-99c4ba71565f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:24.535942 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199f23d-3579-450e-a171-99c4ba71565f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:24.536211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199f23d-3579-450e-a171-99c4ba71565f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:24.536800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199f23d-3579-450e-a171-99c4ba71565f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:24.538349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199f23d-3579-450e-a171-99c4ba71565f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6199f23d-3579-450e-a171-99c4ba71565f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:24.551549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:24.553281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:24.555075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 470/967] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Oct 27 01:14:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:24.563950 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457db8c-ad45-4ea8-aae8-7f6778576b74 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:24.681156 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:24.696980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457db8c-ad45-4ea8-aae8-7f6778576b74 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:24.739878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21340cf-548d-4981-a8d8-362f3e06b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:24.740479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21340cf-548d-4981-a8d8-362f3e06b72d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:24.741136 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21340cf-548d-4981-a8d8-362f3e06b72d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:24.741408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21340cf-548d-4981-a8d8-362f3e06b72d None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:24.742037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21340cf-548d-4981-a8d8-362f3e06b72d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:24.742343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21340cf-548d-4981-a8d8-362f3e06b72d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:24.743726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21340cf-548d-4981-a8d8-362f3e06b72d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:24.748674 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 498/968] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Oct 27 01:14:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:24.755023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199f23d-3579-450e-a171-99c4ba71565f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:24.853950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:24.861019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199f23d-3579-450e-a171-99c4ba71565f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:24.896074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03d53d-8af5-4319-8312-419e7f326e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:24.896680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03d53d-8af5-4319-8312-419e7f326e32 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:24.896959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03d53d-8af5-4319-8312-419e7f326e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:24.897226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03d53d-8af5-4319-8312-419e7f326e32 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:24.897859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03d53d-8af5-4319-8312-419e7f326e32 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:24.898161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03d53d-8af5-4319-8312-419e7f326e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:24.899551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03d53d-8af5-4319-8312-419e7f326e32 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:24.904073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 471/969] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Oct 27 01:14:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:27.060878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4c110-5965-4379-b4cb-0677d3e68a6f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:27.061807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4c110-5965-4379-b4cb-0677d3e68a6f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:27.061807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4c110-5965-4379-b4cb-0677d3e68a6f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:27.064117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 499/970] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:14:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:27.069734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88473e65-aa53-42ab-8fc5-207e31e6432a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:27.070176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88473e65-aa53-42ab-8fc5-207e31e6432a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:27.070274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88473e65-aa53-42ab-8fc5-207e31e6432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:27.090842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-88473e65-aa53-42ab-8fc5-207e31e6432a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:27.092041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-88473e65-aa53-42ab-8fc5-207e31e6432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:27.163338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 472/971] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:14:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:14:27.427955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4c110-5965-4379-b4cb-0677d3e68a6f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:27.546398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4c110-5965-4379-b4cb-0677d3e68a6f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:27.581645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617a350-5c20-47c8-8125-4050a6627b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:27.582247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a350-5c20-47c8-8125-4050a6627b35 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:27.582522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a350-5c20-47c8-8125-4050a6627b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:27.582839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a350-5c20-47c8-8125-4050a6627b35 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:27.583489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617a350-5c20-47c8-8125-4050a6627b35 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:27.584853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617a350-5c20-47c8-8125-4050a6627b35 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:27.602518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 500/972] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Oct 27 01:14:27 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:14:29.708792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba5793-f255-4cdd-9b6e-d5a97b5f56d2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:29.709385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba5793-f255-4cdd-9b6e-d5a97b5f56d2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:29.709385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba5793-f255-4cdd-9b6e-d5a97b5f56d2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:29.710669 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 473/973] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:29.717026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e0c8d-b744-42da-abee-5794205cecb2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:29.717729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e0c8d-b744-42da-abee-5794205cecb2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:29.717877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e0c8d-b744-42da-abee-5794205cecb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:29.741762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-bf9e0c8d-b744-42da-abee-5794205cecb2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:29.743086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bf9e0c8d-b744-42da-abee-5794205cecb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:29.752743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:29.819047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 501/974] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:14:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 01:14:30.083110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba5793-f255-4cdd-9b6e-d5a97b5f56d2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:30.197744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:30.209888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba5793-f255-4cdd-9b6e-d5a97b5f56d2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:30.245353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700a72f-a052-4ba7-bbbf-d915853e524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:30.246023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a72f-a052-4ba7-bbbf-d915853e524b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:30.246297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a72f-a052-4ba7-bbbf-d915853e524b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:30.246562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700a72f-a052-4ba7-bbbf-d915853e524b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:30.247176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700a72f-a052-4ba7-bbbf-d915853e524b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:30.248536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700a72f-a052-4ba7-bbbf-d915853e524b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5700a72f-a052-4ba7-bbbf-d915853e524b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:30.257557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:30.258825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:30.259767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 474/975] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Oct 27 01:14:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:30.265672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e0c8d-b744-42da-abee-5794205cecb2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:30.366255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e0c8d-b744-42da-abee-5794205cecb2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:30.403884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b7013-0cc3-4acb-b5c1-5cf982f20352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:30.404484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b7013-0cc3-4acb-b5c1-5cf982f20352 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:30.404757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b7013-0cc3-4acb-b5c1-5cf982f20352 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:30.405025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b7013-0cc3-4acb-b5c1-5cf982f20352 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:30.405641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b7013-0cc3-4acb-b5c1-5cf982f20352 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:30.405942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b7013-0cc3-4acb-b5c1-5cf982f20352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:30.407337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b7013-0cc3-4acb-b5c1-5cf982f20352 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:30.412513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 502/976] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Oct 27 01:14:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:30.418672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700a72f-a052-4ba7-bbbf-d915853e524b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:30.523431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700a72f-a052-4ba7-bbbf-d915853e524b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:30.563889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece989c6-9c33-4e92-a283-e19089d7df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:30.564661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece989c6-9c33-4e92-a283-e19089d7df66 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:30.564943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece989c6-9c33-4e92-a283-e19089d7df66 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:30.565276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece989c6-9c33-4e92-a283-e19089d7df66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:30.566049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece989c6-9c33-4e92-a283-e19089d7df66 None admin] RBAC: Adding query filter params (interface=public, service_id=45918cb42af547abbc56108aa610b416, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:30.566554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece989c6-9c33-4e92-a283-e19089d7df66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:30.567962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece989c6-9c33-4e92-a283-e19089d7df66 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:30.573507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 475/977] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Oct 27 01:14:30 2022] GET /identity/v3/endpoints?service_id=45918cb42af547abbc56108aa610b416&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:30.579483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b7013-0cc3-4acb-b5c1-5cf982f20352 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:30.583622 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:30.695445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b7013-0cc3-4acb-b5c1-5cf982f20352 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:30.727241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37ce49-d817-4d5c-b859-688bea595839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:30.727843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37ce49-d817-4d5c-b859-688bea595839 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:30.728127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37ce49-d817-4d5c-b859-688bea595839 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:30.728394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37ce49-d817-4d5c-b859-688bea595839 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:30.728993 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37ce49-d817-4d5c-b859-688bea595839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:30.730347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37ce49-d817-4d5c-b859-688bea595839 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:30.737201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 503/978] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Oct 27 01:14:30 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:14:32.844903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe421e-7793-4b57-93f1-dbe634c5c768 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:32.845301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe421e-7793-4b57-93f1-dbe634c5c768 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:32.845516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe421e-7793-4b57-93f1-dbe634c5c768 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:32.847768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 476/979] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:32.855912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19025091-8fc3-474d-bc81-9b1a4bd5437f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:32.856367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19025091-8fc3-474d-bc81-9b1a4bd5437f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:32.856465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19025091-8fc3-474d-bc81-9b1a4bd5437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:32.874924 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-19025091-8fc3-474d-bc81-9b1a4bd5437f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:32.876099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-19025091-8fc3-474d-bc81-9b1a4bd5437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:32.938154 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:32.944368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 504/980] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:14:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 01:14:33.218568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe421e-7793-4b57-93f1-dbe634c5c768 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:33.241983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:33.329163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe421e-7793-4b57-93f1-dbe634c5c768 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:33.370304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f234d5-e3e6-4501-ab7c-278fdd0d1b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:33.371242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f234d5-e3e6-4501-ab7c-278fdd0d1b37 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:33.371607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f234d5-e3e6-4501-ab7c-278fdd0d1b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:33.371970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f234d5-e3e6-4501-ab7c-278fdd0d1b37 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:33.372838 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f234d5-e3e6-4501-ab7c-278fdd0d1b37 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:33.375240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f234d5-e3e6-4501-ab7c-278fdd0d1b37 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-49f234d5-e3e6-4501-ab7c-278fdd0d1b37 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 01:14:33.389354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 01:14:33.390479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Oct 27 01:14:33.391357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 477/981] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Oct 27 01:14:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:14:33.397979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19025091-8fc3-474d-bc81-9b1a4bd5437f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:33.504248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19025091-8fc3-474d-bc81-9b1a4bd5437f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:33.545821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722a7bc-61af-4bff-a405-407b193fd2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:33.546402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a7bc-61af-4bff-a405-407b193fd2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:33.546951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a7bc-61af-4bff-a405-407b193fd2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:33.547294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a7bc-61af-4bff-a405-407b193fd2b8 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:33.547956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722a7bc-61af-4bff-a405-407b193fd2b8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:14:33.548305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722a7bc-61af-4bff-a405-407b193fd2b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:33.549954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722a7bc-61af-4bff-a405-407b193fd2b8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:33.556090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 505/982] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Oct 27 01:14:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:14:33.562305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f234d5-e3e6-4501-ab7c-278fdd0d1b37 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:33.652966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:33.675296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f234d5-e3e6-4501-ab7c-278fdd0d1b37 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:33.711623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d5f6-d195-4a47-8dfe-5e7e6fb6cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:33.712234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d5f6-d195-4a47-8dfe-5e7e6fb6cf75 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:33.712516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d5f6-d195-4a47-8dfe-5e7e6fb6cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:33.712789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d5f6-d195-4a47-8dfe-5e7e6fb6cf75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:33.713459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d5f6-d195-4a47-8dfe-5e7e6fb6cf75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:33.714939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d5f6-d195-4a47-8dfe-5e7e6fb6cf75 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:33.736577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 478/983] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:14:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:14:43.552631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=69 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:14:43.732210 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:37.461651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c21e-f027-41eb-875f-6be951ce0322 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:37.463072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c21e-f027-41eb-875f-6be951ce0322 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:37.463563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c21e-f027-41eb-875f-6be951ce0322 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:37.469285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 506/984] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:15:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:37.470675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ac287-5a08-4cd1-9e6b-d9c2ef246b94 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:37.471138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ac287-5a08-4cd1-9e6b-d9c2ef246b94 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:37.471306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ac287-5a08-4cd1-9e6b-d9c2ef246b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:37.550433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0e1ac287-5a08-4cd1-9e6b-d9c2ef246b94 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:37.552068 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0e1ac287-5a08-4cd1-9e6b-d9c2ef246b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:37.763248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 479/985] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:38.058907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c937b3d-1c60-44ee-bb4a-f7e2ecfe1b77 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.060098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c937b3d-1c60-44ee-bb4a-f7e2ecfe1b77 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.060673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c937b3d-1c60-44ee-bb4a-f7e2ecfe1b77 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.062662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 507/986] 10.222.0.23 () {54 vars in 965 bytes} [Thu Oct 27 01:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:38.068236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712ffc-f93d-403f-9965-363d343ebef3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.068791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712ffc-f93d-403f-9965-363d343ebef3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.069257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712ffc-f93d-403f-9965-363d343ebef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.159745 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-af712ffc-f93d-403f-9965-363d343ebef3 None None] MFA Rules not processed for user `6ae71e9e597240ee88c6bd0754244aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:38.161425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-af712ffc-f93d-403f-9965-363d343ebef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:38.184426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:38.245230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 480/987] 10.222.0.23 () {58 vars in 1062 bytes} [Thu Oct 27 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:38.254352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c937b3d-1c60-44ee-bb4a-f7e2ecfe1b77 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:38.256607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9c937b3d-1c60-44ee-bb4a-f7e2ecfe1b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:38.379495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c937b3d-1c60-44ee-bb4a-f7e2ecfe1b77 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:38.473748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766c4a-c6f8-42cc-9053-6597744853a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:38.475136 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766c4a-c6f8-42cc-9053-6597744853a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.475672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766c4a-c6f8-42cc-9053-6597744853a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.476091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766c4a-c6f8-42cc-9053-6597744853a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.477921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-81766c4a-c6f8-42cc-9053-6597744853a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:38.544183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:38.604182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81766c4a-c6f8-42cc-9053-6597744853a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:38.605646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81766c4a-c6f8-42cc-9053-6597744853a6 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:38.639187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 508/988] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:15:41.088505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ea54a-b30a-4001-bfc6-e6dc7885a91a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:41.088982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ea54a-b30a-4001-bfc6-e6dc7885a91a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:41.089070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ea54a-b30a-4001-bfc6-e6dc7885a91a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:41.090463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 481/989] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:41.096018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1f77-f9f4-40c0-b96e-f838615f768a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:41.096411 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1f77-f9f4-40c0-b96e-f838615f768a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:41.096574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1f77-f9f4-40c0-b96e-f838615f768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:41.178024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3fce1f77-f9f4-40c0-b96e-f838615f768a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:41.179267 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3fce1f77-f9f4-40c0-b96e-f838615f768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:41.279623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 509/990] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:41.581334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5df0-a048-4ebc-a27f-57a50918b5ae None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:41.581586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5df0-a048-4ebc-a27f-57a50918b5ae None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:41.581987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5df0-a048-4ebc-a27f-57a50918b5ae None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:41.584132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 482/991] 10.222.0.23 () {54 vars in 965 bytes} [Thu Oct 27 01:15:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:41.591001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e56a9-a786-4833-990b-03a6cf4cf038 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:41.591396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e56a9-a786-4833-990b-03a6cf4cf038 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:41.591762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e56a9-a786-4833-990b-03a6cf4cf038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:41.610175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:41.684374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b70e56a9-a786-4833-990b-03a6cf4cf038 None None] MFA Rules not processed for user `6ae71e9e597240ee88c6bd0754244aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:41.685595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b70e56a9-a786-4833-990b-03a6cf4cf038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:41.777685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 510/992] 10.222.0.23 () {58 vars in 1062 bytes} [Thu Oct 27 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:41.791571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5df0-a048-4ebc-a27f-57a50918b5ae None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:41.793555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a5fa5df0-a048-4ebc-a27f-57a50918b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:41.905006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5df0-a048-4ebc-a27f-57a50918b5ae None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:41.979762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:41.982360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8aab4-6822-4f0b-9802-9ccd272f608a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:41.983030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8aab4-6822-4f0b-9802-9ccd272f608a service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:41.983313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8aab4-6822-4f0b-9802-9ccd272f608a service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:41.983587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8aab4-6822-4f0b-9802-9ccd272f608a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:41.986194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-13f8aab4-6822-4f0b-9802-9ccd272f608a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:42.104680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8aab4-6822-4f0b-9802-9ccd272f608a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:42.106107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8aab4-6822-4f0b-9802-9ccd272f608a service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:42.124719 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 483/993] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:15:44.819873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2409c43-8b0b-4545-9846-699013f8ad73 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:44.820765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2409c43-8b0b-4545-9846-699013f8ad73 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:44.820765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2409c43-8b0b-4545-9846-699013f8ad73 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:44.823095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 511/994] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:15:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:44.828998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe353b1a-4d4a-4df3-bbce-625183112612 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:44.829415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe353b1a-4d4a-4df3-bbce-625183112612 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:44.829613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe353b1a-4d4a-4df3-bbce-625183112612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:44.897683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fe353b1a-4d4a-4df3-bbce-625183112612 None None] MFA Rules not processed for user `1a8107b76594433a880dd6fc78bcd6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:44.898921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fe353b1a-4d4a-4df3-bbce-625183112612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:44.951530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:44.999507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 484/995] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:45.297516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2409c43-8b0b-4545-9846-699013f8ad73 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:45.299937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e2409c43-8b0b-4545-9846-699013f8ad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:45.414648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2409c43-8b0b-4545-9846-699013f8ad73 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:45.417575 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:45.502960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10952b-69f2-4d2e-b3d2-b5552f3d28cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:45.503596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10952b-69f2-4d2e-b3d2-b5552f3d28cc service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:45.503893 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10952b-69f2-4d2e-b3d2-b5552f3d28cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:45.504258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10952b-69f2-4d2e-b3d2-b5552f3d28cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:45.505994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0f10952b-69f2-4d2e-b3d2-b5552f3d28cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:45.617518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10952b-69f2-4d2e-b3d2-b5552f3d28cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:45.618889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10952b-69f2-4d2e-b3d2-b5552f3d28cc service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:45.638171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 512/996] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:15:48.285508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174ec00-b63c-44a6-b26e-d851d5ca4167 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:48.286127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174ec00-b63c-44a6-b26e-d851d5ca4167 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:48.286127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174ec00-b63c-44a6-b26e-d851d5ca4167 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:48.287436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 485/997] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:48.294171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4e04-68d1-4c0a-be20-b7117d9eebe9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:48.294929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4e04-68d1-4c0a-be20-b7117d9eebe9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:48.295088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4e04-68d1-4c0a-be20-b7117d9eebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:48.350695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:48.378811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a1da4e04-68d1-4c0a-be20-b7117d9eebe9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:48.380034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a1da4e04-68d1-4c0a-be20-b7117d9eebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:48.487994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 513/998] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:48.771028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174ec00-b63c-44a6-b26e-d851d5ca4167 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:48.772625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a174ec00-b63c-44a6-b26e-d851d5ca4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:48.882179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174ec00-b63c-44a6-b26e-d851d5ca4167 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:48.963809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e6c0b-b8da-40a9-8ed7-5bb754dc13ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:48.964418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e6c0b-b8da-40a9-8ed7-5bb754dc13ad service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:48.964691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e6c0b-b8da-40a9-8ed7-5bb754dc13ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:48.964957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e6c0b-b8da-40a9-8ed7-5bb754dc13ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:48.966550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c2e6c0b-b8da-40a9-8ed7-5bb754dc13ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:48.973519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:49.087055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e6c0b-b8da-40a9-8ed7-5bb754dc13ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:49.088420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e6c0b-b8da-40a9-8ed7-5bb754dc13ad service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:49.108533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 486/999] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:15:51.918354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99738f-2445-47b7-8121-864140457061 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:51.918935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99738f-2445-47b7-8121-864140457061 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:51.918935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99738f-2445-47b7-8121-864140457061 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:51.920317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 514/1000] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:51.926028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848c09-a6e9-47fd-b790-581a13843afd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:51.926421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848c09-a6e9-47fd-b790-581a13843afd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:51.926569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848c09-a6e9-47fd-b790-581a13843afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:52.002995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-30848c09-a6e9-47fd-b790-581a13843afd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:52.004228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-30848c09-a6e9-47fd-b790-581a13843afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:52.069847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:52.112764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 487/1001] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:52.390732 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99738f-2445-47b7-8121-864140457061 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:52.392402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7c99738f-2445-47b7-8121-864140457061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:52.496912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99738f-2445-47b7-8121-864140457061 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:52.512343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:52.574603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc714d-9a79-4cae-b6bd-77358c03e9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:52.575252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc714d-9a79-4cae-b6bd-77358c03e9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:52.575530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc714d-9a79-4cae-b6bd-77358c03e9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:52.575799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc714d-9a79-4cae-b6bd-77358c03e9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:52.577385 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9adc714d-9a79-4cae-b6bd-77358c03e9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:52.688323 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc714d-9a79-4cae-b6bd-77358c03e9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:52.689797 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc714d-9a79-4cae-b6bd-77358c03e9d9 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:52.708492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 515/1002] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:15:54.974681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa574ba4-da93-430c-a014-9a3f282502a5 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:54.975301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa574ba4-da93-430c-a014-9a3f282502a5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:54.975301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa574ba4-da93-430c-a014-9a3f282502a5 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:54.976626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 488/1003] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:54.982179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125124c-28e2-46c0-9258-fd8fcf9b5b19 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:54.982635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125124c-28e2-46c0-9258-fd8fcf9b5b19 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:54.982773 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125124c-28e2-46c0-9258-fd8fcf9b5b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:55.042089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:55.060820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8125124c-28e2-46c0-9258-fd8fcf9b5b19 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:55.062020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8125124c-28e2-46c0-9258-fd8fcf9b5b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:55.156609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 516/1004] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:55.436747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa574ba4-da93-430c-a014-9a3f282502a5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:55.438349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fa574ba4-da93-430c-a014-9a3f282502a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:55.548392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa574ba4-da93-430c-a014-9a3f282502a5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:55.625269 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b477c14-a29c-4785-a839-f7a0a1235a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:55.625846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b477c14-a29c-4785-a839-f7a0a1235a08 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:55.626128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b477c14-a29c-4785-a839-f7a0a1235a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:55.626401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b477c14-a29c-4785-a839-f7a0a1235a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:55.628053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1b477c14-a29c-4785-a839-f7a0a1235a08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:55.645955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:55.743443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b477c14-a29c-4785-a839-f7a0a1235a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:55.744873 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b477c14-a29c-4785-a839-f7a0a1235a08 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:55.764173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 489/1005] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:15:57.934824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a500f-5249-4a51-a71d-76261511971f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:57.935355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a500f-5249-4a51-a71d-76261511971f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:57.935355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a500f-5249-4a51-a71d-76261511971f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:57.936648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 517/1006] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:57.942693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09d269-7ee1-4278-8eb8-72226a9f87cd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:57.943528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09d269-7ee1-4278-8eb8-72226a9f87cd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:57.943653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09d269-7ee1-4278-8eb8-72226a9f87cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:58.020322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4d09d269-7ee1-4278-8eb8-72226a9f87cd None None] MFA Rules not processed for user `1a8107b76594433a880dd6fc78bcd6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:58.021523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4d09d269-7ee1-4278-8eb8-72226a9f87cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:58.102331 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:58.131523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 490/1007] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:58.413226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a500f-5249-4a51-a71d-76261511971f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:58.414852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-134a500f-5249-4a51-a71d-76261511971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:58.524605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a500f-5249-4a51-a71d-76261511971f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:58.545724 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:15:58.602878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c648c3-7131-42d2-b46f-7ccc214de8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:58.603489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c648c3-7131-42d2-b46f-7ccc214de8cd service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:58.603761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c648c3-7131-42d2-b46f-7ccc214de8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:58.604025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c648c3-7131-42d2-b46f-7ccc214de8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:58.605628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-12c648c3-7131-42d2-b46f-7ccc214de8cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:58.717847 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c648c3-7131-42d2-b46f-7ccc214de8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:58.719311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c648c3-7131-42d2-b46f-7ccc214de8cd service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:58.737549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 518/1008] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:15:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:01.100301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9befe3-bd5c-45a3-8e3e-73dba89e4cc2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:01.100848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9befe3-bd5c-45a3-8e3e-73dba89e4cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:01.100848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9befe3-bd5c-45a3-8e3e-73dba89e4cc2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:01.102284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 491/1009] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:01.108969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77412f0a-6835-478a-9983-f12b3c53af9f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:01.109723 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77412f0a-6835-478a-9983-f12b3c53af9f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:01.109889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77412f0a-6835-478a-9983-f12b3c53af9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:01.184191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:01.189136 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-77412f0a-6835-478a-9983-f12b3c53af9f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:01.191381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-77412f0a-6835-478a-9983-f12b3c53af9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:01.289040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 519/1010] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:01.574753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9befe3-bd5c-45a3-8e3e-73dba89e4cc2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:01.576377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1b9befe3-bd5c-45a3-8e3e-73dba89e4cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:01.683970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9befe3-bd5c-45a3-8e3e-73dba89e4cc2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:01.758401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d2de6-56a4-40c2-abcc-1efe9fdc87bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:01.759031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d2de6-56a4-40c2-abcc-1efe9fdc87bd service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:01.759306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d2de6-56a4-40c2-abcc-1efe9fdc87bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:01.759574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d2de6-56a4-40c2-abcc-1efe9fdc87bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:01.761516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-511d2de6-56a4-40c2-abcc-1efe9fdc87bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:01.788610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:01.883157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d2de6-56a4-40c2-abcc-1efe9fdc87bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:01.884600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d2de6-56a4-40c2-abcc-1efe9fdc87bd service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:01.904079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 492/1011] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:16:04.084617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65014c-6acd-458f-a047-d8d9bbd70865 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:04.085512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65014c-6acd-458f-a047-d8d9bbd70865 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:04.085512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65014c-6acd-458f-a047-d8d9bbd70865 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:04.087854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 520/1012] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:04.096834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe955c-6df8-4a5c-9368-7a5b6afacbd9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:04.097243 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe955c-6df8-4a5c-9368-7a5b6afacbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:04.097347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe955c-6df8-4a5c-9368-7a5b6afacbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:04.169282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d3fe955c-6df8-4a5c-9368-7a5b6afacbd9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:04.170477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d3fe955c-6df8-4a5c-9368-7a5b6afacbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:04.248984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:04.278668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 493/1013] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:04.563046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65014c-6acd-458f-a047-d8d9bbd70865 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:04.565444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ae65014c-6acd-458f-a047-d8d9bbd70865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:04.680378 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65014c-6acd-458f-a047-d8d9bbd70865 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:04.710505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:04.758837 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a2f84-f63d-47fc-b3bc-c9acafb91232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:04.759468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a2f84-f63d-47fc-b3bc-c9acafb91232 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:04.759744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a2f84-f63d-47fc-b3bc-c9acafb91232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:04.760024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a2f84-f63d-47fc-b3bc-c9acafb91232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:04.762026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8c4a2f84-f63d-47fc-b3bc-c9acafb91232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:04.875339 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a2f84-f63d-47fc-b3bc-c9acafb91232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:04.876778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a2f84-f63d-47fc-b3bc-c9acafb91232 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:04.896930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 521/1014] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:07.377764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a97164-3aee-4294-ba48-fd48dde78537 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:07.378302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a97164-3aee-4294-ba48-fd48dde78537 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:07.378302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a97164-3aee-4294-ba48-fd48dde78537 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:07.379736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 494/1015] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:07.386421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72546b2-12ea-4269-97f9-be747cabdff9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:07.387153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72546b2-12ea-4269-97f9-be747cabdff9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:07.387398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72546b2-12ea-4269-97f9-be747cabdff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:07.461952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c72546b2-12ea-4269-97f9-be747cabdff9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:07.463204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c72546b2-12ea-4269-97f9-be747cabdff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:07.472290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:07.565046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 522/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:07.844690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a97164-3aee-4294-ba48-fd48dde78537 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:07.847039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-68a97164-3aee-4294-ba48-fd48dde78537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:07.951384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a97164-3aee-4294-ba48-fd48dde78537 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:08.040195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f5a9f-c3b3-4b64-bdaa-83c1ac22fd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:08.040807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f5a9f-c3b3-4b64-bdaa-83c1ac22fd94 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:08.041086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f5a9f-c3b3-4b64-bdaa-83c1ac22fd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:08.041358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f5a9f-c3b3-4b64-bdaa-83c1ac22fd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:08.043080 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3f8f5a9f-c3b3-4b64-bdaa-83c1ac22fd94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:08.083138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:08.162760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f5a9f-c3b3-4b64-bdaa-83c1ac22fd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:08.164126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f5a9f-c3b3-4b64-bdaa-83c1ac22fd94 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:08.182407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 495/1017] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:12.626268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b33f5c-b8a8-46e6-9b4c-3558d88a6d2f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:12.626828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b33f5c-b8a8-46e6-9b4c-3558d88a6d2f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:12.626828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b33f5c-b8a8-46e6-9b4c-3558d88a6d2f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:12.628131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 523/1018] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:12.633584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931965f-5d9a-48ad-a5a8-5232b8aa1dd5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:12.634037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931965f-5d9a-48ad-a5a8-5232b8aa1dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:12.634131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931965f-5d9a-48ad-a5a8-5232b8aa1dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:12.703036 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0931965f-5d9a-48ad-a5a8-5232b8aa1dd5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:12.704249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0931965f-5d9a-48ad-a5a8-5232b8aa1dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:12.791372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:12.804242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 496/1019] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:13.084271 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b33f5c-b8a8-46e6-9b4c-3558d88a6d2f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:13.085892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e2b33f5c-b8a8-46e6-9b4c-3558d88a6d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:13.192338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b33f5c-b8a8-46e6-9b4c-3558d88a6d2f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:13.230340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:13.267983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c6e6d-68e6-490a-85b7-e15857b1a54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:13.268599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c6e6d-68e6-490a-85b7-e15857b1a54f service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:13.268864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c6e6d-68e6-490a-85b7-e15857b1a54f service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:13.269149 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c6e6d-68e6-490a-85b7-e15857b1a54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:13.270739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4c8c6e6d-68e6-490a-85b7-e15857b1a54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:13.379821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c6e6d-68e6-490a-85b7-e15857b1a54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:13.381251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c6e6d-68e6-490a-85b7-e15857b1a54f service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:13.400699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 524/1020] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:16.105128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660183-c8f4-40f8-8514-d2dce50d03be None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:16.105714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660183-c8f4-40f8-8514-d2dce50d03be None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:16.105714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660183-c8f4-40f8-8514-d2dce50d03be None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:16.107279 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 497/1021] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:16.112369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c811e-aed4-433c-a252-5858cd1fe1e1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:16.112791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c811e-aed4-433c-a252-5858cd1fe1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:16.112913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c811e-aed4-433c-a252-5858cd1fe1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:16.180479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-186c811e-aed4-433c-a252-5858cd1fe1e1 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:16.181743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-186c811e-aed4-433c-a252-5858cd1fe1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:16.200716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:16.283875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 525/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:16.566805 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31660183-c8f4-40f8-8514-d2dce50d03be None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:16.568411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-31660183-c8f4-40f8-8514-d2dce50d03be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:16.680953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31660183-c8f4-40f8-8514-d2dce50d03be None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:16.759354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfeb051-c057-458b-aca8-eab8b050f22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:16.759971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfeb051-c057-458b-aca8-eab8b050f22b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:16.760220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfeb051-c057-458b-aca8-eab8b050f22b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:16.760525 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfeb051-c057-458b-aca8-eab8b050f22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:16.762472 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3dfeb051-c057-458b-aca8-eab8b050f22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:16.811330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:16.881630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfeb051-c057-458b-aca8-eab8b050f22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:16.883215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfeb051-c057-458b-aca8-eab8b050f22b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:16.902131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 498/1023] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:20.998381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5f914-9b22-40b6-a3a4-d72e1381b4c5 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:20.998955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5f914-9b22-40b6-a3a4-d72e1381b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:20.998955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5f914-9b22-40b6-a3a4-d72e1381b4c5 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:21.000358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 526/1024] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:21.005681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e46da-45d9-4869-960c-a63d45b9575f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:21.006133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e46da-45d9-4869-960c-a63d45b9575f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:21.006288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e46da-45d9-4869-960c-a63d45b9575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:21.077374 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ba3e46da-45d9-4869-960c-a63d45b9575f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:21.078612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ba3e46da-45d9-4869-960c-a63d45b9575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:21.189203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:21.191840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 499/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:21.472447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5f914-9b22-40b6-a3a4-d72e1381b4c5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:21.474063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f9a5f914-9b22-40b6-a3a4-d72e1381b4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:21.585144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5f914-9b22-40b6-a3a4-d72e1381b4c5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:21.633764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:21.660480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e0b26-a353-4460-822c-f0033d085d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:21.661368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0b26-a353-4460-822c-f0033d085d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:21.661735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0b26-a353-4460-822c-f0033d085d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:21.662113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0b26-a353-4460-822c-f0033d085d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:21.664717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-286e0b26-a353-4460-822c-f0033d085d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:21.796976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e0b26-a353-4460-822c-f0033d085d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:21.798399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e0b26-a353-4460-822c-f0033d085d5c service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:21.817628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 527/1026] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:26.707268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905df76-2c5b-458c-b113-213a0bf72448 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:26.707268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905df76-2c5b-458c-b113-213a0bf72448 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:26.707268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905df76-2c5b-458c-b113-213a0bf72448 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:26.709482 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 500/1027] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:16:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:26.715374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bc89d-1ef7-4c9d-bde0-7bb8b0cb7089 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:26.715784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bc89d-1ef7-4c9d-bde0-7bb8b0cb7089 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:26.715784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bc89d-1ef7-4c9d-bde0-7bb8b0cb7089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:26.819608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b82bc89d-1ef7-4c9d-bde0-7bb8b0cb7089 None None] MFA Rules not processed for user `bc32363c074f4418964ea46068a28831`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:26.820684 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b82bc89d-1ef7-4c9d-bde0-7bb8b0cb7089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:26.866057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:26.972466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 528/1028] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:31.014655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c49b-5655-41b4-b6f3-9ef3667b56ed None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:31.015280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c49b-5655-41b4-b6f3-9ef3667b56ed None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:31.015280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c49b-5655-41b4-b6f3-9ef3667b56ed None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:31.016820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 501/1029] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:31.021902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a887539-70f6-46be-ade9-4f01278f1461 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:31.022351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a887539-70f6-46be-ade9-4f01278f1461 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:31.022631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a887539-70f6-46be-ade9-4f01278f1461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:31.106442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4a887539-70f6-46be-ade9-4f01278f1461 None None] MFA Rules not processed for user `bc32363c074f4418964ea46068a28831`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:31.107600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4a887539-70f6-46be-ade9-4f01278f1461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:31.183277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:31.221404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 529/1030] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:32.571582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996ed8-64be-4b4d-940f-6079e50849d4 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:32.572175 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996ed8-64be-4b4d-940f-6079e50849d4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:32.572175 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996ed8-64be-4b4d-940f-6079e50849d4 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:32.573468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 502/1031] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:32.578696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471be62c-70c0-4261-8d7d-a9c7e679ec52 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:32.579131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471be62c-70c0-4261-8d7d-a9c7e679ec52 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:32.579284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471be62c-70c0-4261-8d7d-a9c7e679ec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:32.661202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-471be62c-70c0-4261-8d7d-a9c7e679ec52 None None] MFA Rules not processed for user `bc32363c074f4418964ea46068a28831`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:32.662438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-471be62c-70c0-4261-8d7d-a9c7e679ec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:32.770361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 530/1032] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:36.339455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555a58f-4437-42c2-9206-3ffdd6ed3485 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:36.340333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555a58f-4437-42c2-9206-3ffdd6ed3485 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:36.340879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555a58f-4437-42c2-9206-3ffdd6ed3485 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:36.343875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 503/1033] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:36.348453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b776-7093-471b-b3be-6af9f6b5007f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:36.349247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b776-7093-471b-b3be-6af9f6b5007f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:36.349528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b776-7093-471b-b3be-6af9f6b5007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:36.387127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:36.424111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c7c2b776-7093-471b-b3be-6af9f6b5007f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:36.425449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c7c2b776-7093-471b-b3be-6af9f6b5007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:36.537290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 531/1034] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:36.839603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873e25-bc9d-4498-b881-9bbb090f3b90 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:36.840143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873e25-bc9d-4498-b881-9bbb090f3b90 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:36.840653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873e25-bc9d-4498-b881-9bbb090f3b90 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:36.842393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 504/1035] 10.222.0.23 () {54 vars in 961 bytes} [Thu Oct 27 01:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:36.853955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa42526-81e1-41ff-8b1b-548025eb66de None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:36.854263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa42526-81e1-41ff-8b1b-548025eb66de None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:36.854527 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa42526-81e1-41ff-8b1b-548025eb66de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:36.936541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4fa42526-81e1-41ff-8b1b-548025eb66de None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:36.937721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4fa42526-81e1-41ff-8b1b-548025eb66de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:36.988811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:37.064673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 532/1036] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Oct 27 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:37.072922 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7873e25-bc9d-4498-b881-9bbb090f3b90 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:37.074509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a7873e25-bc9d-4498-b881-9bbb090f3b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:37.233218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7873e25-bc9d-4498-b881-9bbb090f3b90 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:37.309286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:37.357020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e43ee-4108-4ce1-afec-98763eab1ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:37.357873 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e43ee-4108-4ce1-afec-98763eab1ecc service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:37.358268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e43ee-4108-4ce1-afec-98763eab1ecc service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:37.358636 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e43ee-4108-4ce1-afec-98763eab1ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:37.360522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-661e43ee-4108-4ce1-afec-98763eab1ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:37.467363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e43ee-4108-4ce1-afec-98763eab1ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:37.469137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e43ee-4108-4ce1-afec-98763eab1ecc service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:37.489530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 505/1037] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:16:39.842568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee202442-114f-452f-8343-c2f8d9edcdfc None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:39.847358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee202442-114f-452f-8343-c2f8d9edcdfc None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:39.847358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee202442-114f-452f-8343-c2f8d9edcdfc None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:39.849862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bb9dd-97ba-42c2-8335-f1d07035c993 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:39.853805 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bb9dd-97ba-42c2-8335-f1d07035c993 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:39.853805 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bb9dd-97ba-42c2-8335-f1d07035c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:39.855350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 533/1038] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:39.917848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f60bb9dd-97ba-42c2-8335-f1d07035c993 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:39.919148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f60bb9dd-97ba-42c2-8335-f1d07035c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:39.958005 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:40.021386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 506/1039] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:40.302871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee202442-114f-452f-8343-c2f8d9edcdfc None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:40.304408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ee202442-114f-452f-8343-c2f8d9edcdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:40.492250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee202442-114f-452f-8343-c2f8d9edcdfc None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:40.505393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:40.626217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c6e0-d10e-423e-83cf-01e2e9a6d5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:40.626860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c6e0-d10e-423e-83cf-01e2e9a6d5d8 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:40.627134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c6e0-d10e-423e-83cf-01e2e9a6d5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:40.627402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c6e0-d10e-423e-83cf-01e2e9a6d5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:40.629006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d874c6e0-d10e-423e-83cf-01e2e9a6d5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:40.719860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c6e0-d10e-423e-83cf-01e2e9a6d5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:40.721500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c6e0-d10e-423e-83cf-01e2e9a6d5d8 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:40.740921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 534/1040] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:43.208283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bd5a3-b811-4e4e-8f70-735ee430f1aa None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:43.208855 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bd5a3-b811-4e4e-8f70-735ee430f1aa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:43.208855 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bd5a3-b811-4e4e-8f70-735ee430f1aa None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:43.210151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 507/1041] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:43.215711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aae2e-94e7-4ff8-8617-36a85aca0f6a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:43.216165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aae2e-94e7-4ff8-8617-36a85aca0f6a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:43.216248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aae2e-94e7-4ff8-8617-36a85aca0f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:43.231899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:43.291116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0d6aae2e-94e7-4ff8-8617-36a85aca0f6a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:43.292319 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0d6aae2e-94e7-4ff8-8617-36a85aca0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:43.394275 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 535/1042] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:16:43.681347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19159d34-eed3-4e53-9dad-2011171d06e9 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:43.681591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19159d34-eed3-4e53-9dad-2011171d06e9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:43.681862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19159d34-eed3-4e53-9dad-2011171d06e9 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:43.683443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 508/1043] 10.222.0.23 () {54 vars in 961 bytes} [Thu Oct 27 01:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:16:43.689055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d270f-e059-4406-a053-b3b1c1bb1f72 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:43.689316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d270f-e059-4406-a053-b3b1c1bb1f72 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:43.689605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d270f-e059-4406-a053-b3b1c1bb1f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:43.768920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b60d270f-e059-4406-a053-b3b1c1bb1f72 None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:43.770125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b60d270f-e059-4406-a053-b3b1c1bb1f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:43.806162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:43.901608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 536/1044] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Oct 27 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:43.909486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19159d34-eed3-4e53-9dad-2011171d06e9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:43.911202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-19159d34-eed3-4e53-9dad-2011171d06e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:44.065851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19159d34-eed3-4e53-9dad-2011171d06e9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:44.087044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:44.188848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a73b40-4aa2-4528-b5bf-68ff280ef86a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:44.189463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a73b40-4aa2-4528-b5bf-68ff280ef86a service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:44.189740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a73b40-4aa2-4528-b5bf-68ff280ef86a service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:44.189993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a73b40-4aa2-4528-b5bf-68ff280ef86a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:44.191634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-31a73b40-4aa2-4528-b5bf-68ff280ef86a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:44.292495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a73b40-4aa2-4528-b5bf-68ff280ef86a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:44.294126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a73b40-4aa2-4528-b5bf-68ff280ef86a service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:44.313449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 509/1045] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:16:44.333016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13fbc9-0899-4c5d-a0ee-a07286c68f6e None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:44.333459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13fbc9-0899-4c5d-a0ee-a07286c68f6e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:44.333561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13fbc9-0899-4c5d-a0ee-a07286c68f6e None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:44.335101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 537/1046] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:44.340395 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e622e08-f681-47f4-b891-0e55326cd06b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:44.340556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e622e08-f681-47f4-b891-0e55326cd06b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:44.340752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e622e08-f681-47f4-b891-0e55326cd06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:44.376725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:44.415109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8e622e08-f681-47f4-b891-0e55326cd06b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:44.416637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8e622e08-f681-47f4-b891-0e55326cd06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:44.537846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 510/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:44.865407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f720b42-d640-4731-9643-774c5c459078 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:44.865407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f720b42-d640-4731-9643-774c5c459078 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:44.865407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f720b42-d640-4731-9643-774c5c459078 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:44.867563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 538/1048] 10.222.0.23 () {54 vars in 963 bytes} [Thu Oct 27 01:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:44.872637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06721b73-d275-4ae2-ad89-3c17fcf8ad4b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:44.872882 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06721b73-d275-4ae2-ad89-3c17fcf8ad4b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:44.873185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06721b73-d275-4ae2-ad89-3c17fcf8ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:44.954290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-06721b73-d275-4ae2-ad89-3c17fcf8ad4b None None] MFA Rules not processed for user `095bc16a66c24f44939009ac95e2bc3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:44.955527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-06721b73-d275-4ae2-ad89-3c17fcf8ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:45.006814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:45.046884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 511/1049] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Oct 27 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:45.051894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f720b42-d640-4731-9643-774c5c459078 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:45.053428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7f720b42-d640-4731-9643-774c5c459078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:45.168344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f720b42-d640-4731-9643-774c5c459078 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:45.213312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:45.257032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ea509-a279-4d63-95d4-743fc227c951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:45.257685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ea509-a279-4d63-95d4-743fc227c951 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:45.257974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ea509-a279-4d63-95d4-743fc227c951 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:45.258254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ea509-a279-4d63-95d4-743fc227c951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:45.260065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-594ea509-a279-4d63-95d4-743fc227c951 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:45.442620 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ea509-a279-4d63-95d4-743fc227c951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:45.444121 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ea509-a279-4d63-95d4-743fc227c951 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:45.465733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 539/1050] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:46.542366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac78a9-b12b-4c22-943a-d49cd727842d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:46.542941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac78a9-b12b-4c22-943a-d49cd727842d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:46.542941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac78a9-b12b-4c22-943a-d49cd727842d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:46.544398 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 512/1051] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:46.550202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039b9fc-82b8-4cd1-b4a5-3de8444b2410 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:46.550691 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039b9fc-82b8-4cd1-b4a5-3de8444b2410 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:46.550826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039b9fc-82b8-4cd1-b4a5-3de8444b2410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:46.619430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6039b9fc-82b8-4cd1-b4a5-3de8444b2410 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:46.620660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6039b9fc-82b8-4cd1-b4a5-3de8444b2410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:46.641790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:46.717752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 540/1052] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:47.006602 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac78a9-b12b-4c22-943a-d49cd727842d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:47.008186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-75ac78a9-b12b-4c22-943a-d49cd727842d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:47.170407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac78a9-b12b-4c22-943a-d49cd727842d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:47.221767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:47.283891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0614b9-3c43-4771-a3f4-f173c6d6159c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:47.284581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0614b9-3c43-4771-a3f4-f173c6d6159c service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:47.284783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0614b9-3c43-4771-a3f4-f173c6d6159c service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:47.285050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0614b9-3c43-4771-a3f4-f173c6d6159c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:47.286634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1b0614b9-3c43-4771-a3f4-f173c6d6159c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:47.378111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0614b9-3c43-4771-a3f4-f173c6d6159c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:47.379725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0614b9-3c43-4771-a3f4-f173c6d6159c service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:47.398550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 513/1053] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:49.583342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7ef3-fbfb-4f8a-b67d-63171a3bcedf None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:49.583897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7ef3-fbfb-4f8a-b67d-63171a3bcedf None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:49.583897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7ef3-fbfb-4f8a-b67d-63171a3bcedf None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:49.585685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 541/1054] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:49.591065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d8c1-b774-4138-8e17-33a770981130 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:49.591513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d8c1-b774-4138-8e17-33a770981130 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:49.591595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d8c1-b774-4138-8e17-33a770981130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:49.668427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3f01d8c1-b774-4138-8e17-33a770981130 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:49.669660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3f01d8c1-b774-4138-8e17-33a770981130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:49.678138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:49.780963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 514/1055] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:50.058085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7ef3-fbfb-4f8a-b67d-63171a3bcedf None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:50.060085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-571e7ef3-fbfb-4f8a-b67d-63171a3bcedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:50.215211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7ef3-fbfb-4f8a-b67d-63171a3bcedf None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:50.219454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:50.337222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f449a9-52d5-498d-9e89-7e22a6132544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:50.337938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f449a9-52d5-498d-9e89-7e22a6132544 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:50.338318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f449a9-52d5-498d-9e89-7e22a6132544 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:50.338690 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f449a9-52d5-498d-9e89-7e22a6132544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:50.340726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b6f449a9-52d5-498d-9e89-7e22a6132544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:50.439048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f449a9-52d5-498d-9e89-7e22a6132544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:50.440708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f449a9-52d5-498d-9e89-7e22a6132544 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:50.460649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 542/1056] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:52.637783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ad2e8-2677-4717-99da-89a0ccd07b29 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:52.638278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ad2e8-2677-4717-99da-89a0ccd07b29 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:52.638377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ad2e8-2677-4717-99da-89a0ccd07b29 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:52.642772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 515/1057] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:52.645086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92fd7d-cab4-46ed-8af9-9a989ea3e4ac None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:52.645490 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92fd7d-cab4-46ed-8af9-9a989ea3e4ac None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:52.645639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92fd7d-cab4-46ed-8af9-9a989ea3e4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:52.657963 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:52.715658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4c92fd7d-cab4-46ed-8af9-9a989ea3e4ac None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:52.717367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4c92fd7d-cab4-46ed-8af9-9a989ea3e4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:52.823202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 543/1058] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:53.111526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ad2e8-2677-4717-99da-89a0ccd07b29 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:53.113360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7b8ad2e8-2677-4717-99da-89a0ccd07b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:53.262392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:53.273685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ad2e8-2677-4717-99da-89a0ccd07b29 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:53.395619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f8dbb-51f1-4c94-aec5-17add69ebd39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:53.396257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f8dbb-51f1-4c94-aec5-17add69ebd39 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:53.396541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f8dbb-51f1-4c94-aec5-17add69ebd39 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:53.396815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f8dbb-51f1-4c94-aec5-17add69ebd39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:53.398468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f17f8dbb-51f1-4c94-aec5-17add69ebd39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:53.497211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f8dbb-51f1-4c94-aec5-17add69ebd39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:53.499527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f8dbb-51f1-4c94-aec5-17add69ebd39 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:53.515514 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:53.528031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 516/1059] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:56.268160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288d4aa-0370-4efa-8760-7f73498b0542 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:56.268772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288d4aa-0370-4efa-8760-7f73498b0542 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:56.268917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288d4aa-0370-4efa-8760-7f73498b0542 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:56.271036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 544/1060] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:56.277638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104914-4081-4640-acc9-d77657dc6c78 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:56.278144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104914-4081-4640-acc9-d77657dc6c78 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:56.278540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104914-4081-4640-acc9-d77657dc6c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:56.365453 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-84104914-4081-4640-acc9-d77657dc6c78 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:56.366927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-84104914-4081-4640-acc9-d77657dc6c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:56.476650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 517/1061] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:56.771022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288d4aa-0370-4efa-8760-7f73498b0542 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:56.773195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7288d4aa-0370-4efa-8760-7f73498b0542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:56.873809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:56.938626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288d4aa-0370-4efa-8760-7f73498b0542 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:16:57.054786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b08d51-68a9-4579-aa57-7f8e4440ecea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:16:57.055307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b08d51-68a9-4579-aa57-7f8e4440ecea service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:57.055586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b08d51-68a9-4579-aa57-7f8e4440ecea service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:57.055873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b08d51-68a9-4579-aa57-7f8e4440ecea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:57.057506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-20b08d51-68a9-4579-aa57-7f8e4440ecea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:57.109796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:57.152464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b08d51-68a9-4579-aa57-7f8e4440ecea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:16:57.154134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b08d51-68a9-4579-aa57-7f8e4440ecea service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:16:57.172886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 545/1062] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:16:59.457311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d4d32-a49c-4499-a310-2782119c15f4 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:59.457907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d4d32-a49c-4499-a310-2782119c15f4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:59.457907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d4d32-a49c-4499-a310-2782119c15f4 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:59.459256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 518/1063] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:16:59.464713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df0b96-9a2a-4a90-ad71-3a1bff22e16f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:16:59.465170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df0b96-9a2a-4a90-ad71-3a1bff22e16f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:16:59.465318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df0b96-9a2a-4a90-ad71-3a1bff22e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:16:59.544938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b1df0b96-9a2a-4a90-ad71-3a1bff22e16f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:16:59.546161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b1df0b96-9a2a-4a90-ad71-3a1bff22e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:16:59.646982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 546/1064] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:16:59.939575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d4d32-a49c-4499-a310-2782119c15f4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:16:59.941083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9e2d4d32-a49c-4499-a310-2782119c15f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:00.022795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:00.094387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d4d32-a49c-4499-a310-2782119c15f4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:00.215249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36b0f6-55f9-4760-bcf3-f2abae0e1acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:00.215875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b0f6-55f9-4760-bcf3-f2abae0e1acf service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:00.216122 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b0f6-55f9-4760-bcf3-f2abae0e1acf service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:00.216427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b0f6-55f9-4760-bcf3-f2abae0e1acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:00.218046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0d36b0f6-55f9-4760-bcf3-f2abae0e1acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:00.259114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:00.314071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36b0f6-55f9-4760-bcf3-f2abae0e1acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:00.315711 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36b0f6-55f9-4760-bcf3-f2abae0e1acf service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:00.334481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 519/1065] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:00.487432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749937a1-10e9-4d3d-829f-46252e84307c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:00.488001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749937a1-10e9-4d3d-829f-46252e84307c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:00.488001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749937a1-10e9-4d3d-829f-46252e84307c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:00.489260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 547/1066] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:00.495377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93b91-31aa-4893-a6db-f25c6f707772 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:00.496000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93b91-31aa-4893-a6db-f25c6f707772 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:00.496000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93b91-31aa-4893-a6db-f25c6f707772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:00.573271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5ea93b91-31aa-4893-a6db-f25c6f707772 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:00.574664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5ea93b91-31aa-4893-a6db-f25c6f707772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:00.678426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 520/1067] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:00.977141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bc121-9803-49c5-aeeb-c8fb28dda0fd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:00.977479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bc121-9803-49c5-aeeb-c8fb28dda0fd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:00.977756 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bc121-9803-49c5-aeeb-c8fb28dda0fd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:00.979182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 548/1068] 10.222.0.23 () {54 vars in 962 bytes} [Thu Oct 27 01:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:00.984695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bbef-2281-4374-98be-99a912c37fed None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:00.984985 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bbef-2281-4374-98be-99a912c37fed None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:00.985263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bbef-2281-4374-98be-99a912c37fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:01.001533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:01.063418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b896bbef-2281-4374-98be-99a912c37fed None None] MFA Rules not processed for user `0ea18d542ca24e39ac758f34ad65e7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:01.064619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b896bbef-2281-4374-98be-99a912c37fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:01.143361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 521/1069] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Oct 27 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:01.151206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bc121-9803-49c5-aeeb-c8fb28dda0fd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:01.152718 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bc4bc121-9803-49c5-aeeb-c8fb28dda0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:01.183980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:01.259694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bc121-9803-49c5-aeeb-c8fb28dda0fd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:01.348302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f298c5-5a8a-4de6-8f98-e7f47a8b5569 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ea18d542ca24e39ac758f34ad65e7bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:01.348929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f298c5-5a8a-4de6-8f98-e7f47a8b5569 service glance] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:01.349204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f298c5-5a8a-4de6-8f98-e7f47a8b5569 service glance] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:01.349508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f298c5-5a8a-4de6-8f98-e7f47a8b5569 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:01.351175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-62f298c5-5a8a-4de6-8f98-e7f47a8b5569 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:01.435384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:01.469918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f298c5-5a8a-4de6-8f98-e7f47a8b5569 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:01.471413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f298c5-5a8a-4de6-8f98-e7f47a8b5569 service glance] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:01.489706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 549/1070] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:02.237653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c643f19-962a-46d0-913a-1e281a9388bd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:02.238126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c643f19-962a-46d0-913a-1e281a9388bd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:02.238344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c643f19-962a-46d0-913a-1e281a9388bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:02.309491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4c643f19-962a-46d0-913a-1e281a9388bd None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:02.310751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4c643f19-962a-46d0-913a-1e281a9388bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:02.369233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:02.407200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 522/1071] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:02.456197 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa530ee-1ffa-4fd8-9a0f-1f991578f2d9 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:02.456524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa530ee-1ffa-4fd8-9a0f-1f991578f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:02.456728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa530ee-1ffa-4fd8-9a0f-1f991578f2d9 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:02.458347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 550/1072] 10.222.0.23 () {54 vars in 943 bytes} [Thu Oct 27 01:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:02.464859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636ea0-0088-4440-a0d7-ec732cabd978 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:02.465386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636ea0-0088-4440-a0d7-ec732cabd978 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:02.465761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636ea0-0088-4440-a0d7-ec732cabd978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:02.539710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244aa21-bc23-4fc3-982c-b27c2a6eb3dd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:02.541501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244aa21-bc23-4fc3-982c-b27c2a6eb3dd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:02.541860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244aa21-bc23-4fc3-982c-b27c2a6eb3dd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:02.543557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 551/1073] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:17:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:17:02.549245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf764e-0c39-4772-981b-cac47c55d18d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:02.549681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf764e-0c39-4772-981b-cac47c55d18d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:02.549937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf764e-0c39-4772-981b-cac47c55d18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:02.572114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-38636ea0-0088-4440-a0d7-ec732cabd978 None None] MFA Rules not processed for user `b38639ab90e5439a990cf603c627dab3`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:02.573517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-38636ea0-0088-4440-a0d7-ec732cabd978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:02.621821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c4cf764e-0c39-4772-981b-cac47c55d18d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:02.623177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c4cf764e-0c39-4772-981b-cac47c55d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:02.684196 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 523/1074] 10.222.0.23 () {58 vars in 1040 bytes} [Thu Oct 27 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:02.693218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636ea0-0088-4440-a0d7-ec732cabd978 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:02.702641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636ea0-0088-4440-a0d7-ec732cabd978 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:02.722625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 552/1075] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:17:02.729622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:02.808620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4396-d089-4b0d-9698-ec28d75a36c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:02.809232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4396-d089-4b0d-9698-ec28d75a36c0 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:02.809504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4396-d089-4b0d-9698-ec28d75a36c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:02.809767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4396-d089-4b0d-9698-ec28d75a36c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:02.811429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dd7e4396-d089-4b0d-9698-ec28d75a36c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:02.903015 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4396-d089-4b0d-9698-ec28d75a36c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:02.904763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4396-d089-4b0d-9698-ec28d75a36c0 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:02.913126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 524/1076] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:17:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 01:17:03.012093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf764e-0c39-4772-981b-cac47c55d18d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:03.013538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c4cf764e-0c39-4772-981b-cac47c55d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:03.056808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:03.142421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf764e-0c39-4772-981b-cac47c55d18d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:03.269561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fda10-ce13-423e-8dbe-803693bd2a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:03.270379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fda10-ce13-423e-8dbe-803693bd2a47 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:03.270783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fda10-ce13-423e-8dbe-803693bd2a47 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:03.271151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fda10-ce13-423e-8dbe-803693bd2a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:03.272852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-124fda10-ce13-423e-8dbe-803693bd2a47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:03.311157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:03.372556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fda10-ce13-423e-8dbe-803693bd2a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:03.374399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fda10-ce13-423e-8dbe-803693bd2a47 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:03.395246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 553/1077] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:05.594608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582f219-0dd4-4f4b-9389-0ede301345a3 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:05.594608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582f219-0dd4-4f4b-9389-0ede301345a3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:05.594608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582f219-0dd4-4f4b-9389-0ede301345a3 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:05.600658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653aa9e-a541-4fbc-a3bf-28dc6e7e08cf None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:05.601110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653aa9e-a541-4fbc-a3bf-28dc6e7e08cf None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:05.601241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653aa9e-a541-4fbc-a3bf-28dc6e7e08cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:05.604094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 525/1078] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:17:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:05.673266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b653aa9e-a541-4fbc-a3bf-28dc6e7e08cf None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:05.674418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b653aa9e-a541-4fbc-a3bf-28dc6e7e08cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:05.776462 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 554/1079] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:06.067099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582f219-0dd4-4f4b-9389-0ede301345a3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:06.068636 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0582f219-0dd4-4f4b-9389-0ede301345a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:06.137400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:06.233207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582f219-0dd4-4f4b-9389-0ede301345a3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:06.356787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc76a0d-b067-4b7a-afcf-4d249d5bb0d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:06.357304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc76a0d-b067-4b7a-afcf-4d249d5bb0d4 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:06.357598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc76a0d-b067-4b7a-afcf-4d249d5bb0d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:06.357837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc76a0d-b067-4b7a-afcf-4d249d5bb0d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:06.359539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3fc76a0d-b067-4b7a-afcf-4d249d5bb0d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:06.381618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:06.465025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc76a0d-b067-4b7a-afcf-4d249d5bb0d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:06.467095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc76a0d-b067-4b7a-afcf-4d249d5bb0d4 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:06.485680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 526/1080] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:08.680561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644f37-27a6-46ee-a2e9-11599af7cadf None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:08.680561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644f37-27a6-46ee-a2e9-11599af7cadf None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:08.680561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644f37-27a6-46ee-a2e9-11599af7cadf None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:08.681671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 555/1081] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:08.687879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb40528-fae5-4f75-b958-bf11fe7168a9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:08.688394 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb40528-fae5-4f75-b958-bf11fe7168a9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:08.688491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb40528-fae5-4f75-b958-bf11fe7168a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:08.756555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6fb40528-fae5-4f75-b958-bf11fe7168a9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:08.757786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6fb40528-fae5-4f75-b958-bf11fe7168a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:08.866485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:08.876288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 527/1082] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:09.162279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644f37-27a6-46ee-a2e9-11599af7cadf None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:09.164090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-87644f37-27a6-46ee-a2e9-11599af7cadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:09.175041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:09.370006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644f37-27a6-46ee-a2e9-11599af7cadf None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:09.460862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:09.496425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e377b-0fe4-4d8c-bc35-2d611aaf6f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:09.497042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e377b-0fe4-4d8c-bc35-2d611aaf6f6b service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:09.497326 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e377b-0fe4-4d8c-bc35-2d611aaf6f6b service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:09.497585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e377b-0fe4-4d8c-bc35-2d611aaf6f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:09.499222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0d1e377b-0fe4-4d8c-bc35-2d611aaf6f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:09.599611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e377b-0fe4-4d8c-bc35-2d611aaf6f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:09.602824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e377b-0fe4-4d8c-bc35-2d611aaf6f6b service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:09.628383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 556/1083] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:11.805859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2c3c-8268-4399-b123-5f6fbfeadb3a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:11.806463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2c3c-8268-4399-b123-5f6fbfeadb3a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:11.806707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d2c3c-8268-4399-b123-5f6fbfeadb3a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:11.808557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 528/1084] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:11.813610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3cd9-496f-4ba0-80a8-ae81d1d9f357 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:11.814076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3cd9-496f-4ba0-80a8-ae81d1d9f357 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:11.814171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3cd9-496f-4ba0-80a8-ae81d1d9f357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:11.893343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7b6d3cd9-496f-4ba0-80a8-ae81d1d9f357 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:11.894555 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7b6d3cd9-496f-4ba0-80a8-ae81d1d9f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:11.943230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:11.993728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 557/1085] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:12.276137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d2c3c-8268-4399-b123-5f6fbfeadb3a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:12.277864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-259d2c3c-8268-4399-b123-5f6fbfeadb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:12.437888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d2c3c-8268-4399-b123-5f6fbfeadb3a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:12.512722 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:12.565217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9902b-e759-4973-9f22-818dc63b93f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:12.565833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9902b-e759-4973-9f22-818dc63b93f1 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:12.566114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9902b-e759-4973-9f22-818dc63b93f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:12.566382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9902b-e759-4973-9f22-818dc63b93f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:12.568078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-16e9902b-e759-4973-9f22-818dc63b93f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:12.672562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9902b-e759-4973-9f22-818dc63b93f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:12.674163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9902b-e759-4973-9f22-818dc63b93f1 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:12.692879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 529/1086] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:21.992268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=23 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:22.693526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=64 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:25.413629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2bc4f-dfdb-42b0-a16f-161a43b2626e None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:25.414189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2bc4f-dfdb-42b0-a16f-161a43b2626e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:25.414189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2bc4f-dfdb-42b0-a16f-161a43b2626e None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:25.415555 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 558/1087] 10.222.0.23 () {54 vars in 918 bytes} [Thu Oct 27 01:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:17:25.421147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079abb86-dbc3-40ca-bb3e-609a32939290 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:25.421592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079abb86-dbc3-40ca-bb3e-609a32939290 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:25.421709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079abb86-dbc3-40ca-bb3e-609a32939290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:25.499108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-079abb86-dbc3-40ca-bb3e-609a32939290 None None] MFA Rules not processed for user `bc32363c074f4418964ea46068a28831`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:25.500295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-079abb86-dbc3-40ca-bb3e-609a32939290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:25.611612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 530/1088] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Oct 27 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:25.626341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c89eb7-55e7-4657-b15e-b6ed144c7092 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:25.626537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c89eb7-55e7-4657-b15e-b6ed144c7092 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:25.626867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c89eb7-55e7-4657-b15e-b6ed144c7092 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:25.628213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 559/1089] 10.222.0.23 () {54 vars in 918 bytes} [Thu Oct 27 01:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:25.632920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde86e58-99dd-4654-a923-6ad5c507f9bc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:25.633213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde86e58-99dd-4654-a923-6ad5c507f9bc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:25.633488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde86e58-99dd-4654-a923-6ad5c507f9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:25.717770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:25.721267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bde86e58-99dd-4654-a923-6ad5c507f9bc None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:25.723135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bde86e58-99dd-4654-a923-6ad5c507f9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:25.848378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 531/1090] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Oct 27 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:28.394517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba6b42-ce9c-4dd6-beac-24f1825efb10 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:28.395430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba6b42-ce9c-4dd6-beac-24f1825efb10 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:28.395430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba6b42-ce9c-4dd6-beac-24f1825efb10 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:28.397432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 560/1091] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:17:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:28.404753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d071-5ccb-4dc9-8c82-28bde2cd0148 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:28.405252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d071-5ccb-4dc9-8c82-28bde2cd0148 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:28.405348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d071-5ccb-4dc9-8c82-28bde2cd0148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:28.477063 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-dc37d071-5ccb-4dc9-8c82-28bde2cd0148 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:28.478281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dc37d071-5ccb-4dc9-8c82-28bde2cd0148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:28.535673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:28.579313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 532/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:28.870634 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba6b42-ce9c-4dd6-beac-24f1825efb10 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:28.872245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e0ba6b42-ce9c-4dd6-beac-24f1825efb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:29.027685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba6b42-ce9c-4dd6-beac-24f1825efb10 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:29.104908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:29.147513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19257be2-a8d3-41bf-b4c3-d581648c1b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:29.148125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19257be2-a8d3-41bf-b4c3-d581648c1b97 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:29.148400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19257be2-a8d3-41bf-b4c3-d581648c1b97 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:29.148671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19257be2-a8d3-41bf-b4c3-d581648c1b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:29.150293 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-19257be2-a8d3-41bf-b4c3-d581648c1b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:29.241460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19257be2-a8d3-41bf-b4c3-d581648c1b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:29.243053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19257be2-a8d3-41bf-b4c3-d581648c1b97 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:29.261347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 561/1093] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:30.397193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85bbb1-3c1c-4659-9eb0-5837e18fa013 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:30.398061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85bbb1-3c1c-4659-9eb0-5837e18fa013 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:30.398061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85bbb1-3c1c-4659-9eb0-5837e18fa013 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:30.400251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 533/1094] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:17:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:30.406298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3f3a8-304d-4d66-82d6-ec8020db3471 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:30.406781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3f3a8-304d-4d66-82d6-ec8020db3471 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:30.406900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3f3a8-304d-4d66-82d6-ec8020db3471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:30.489010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-aeb3f3a8-304d-4d66-82d6-ec8020db3471 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:30.490212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-aeb3f3a8-304d-4d66-82d6-ec8020db3471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:30.517614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:30.586578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 562/1095] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:30.756134 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85bbb1-3c1c-4659-9eb0-5837e18fa013 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:30.757663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2d85bbb1-3c1c-4659-9eb0-5837e18fa013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:30.917270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85bbb1-3c1c-4659-9eb0-5837e18fa013 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:30.964230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:31.042762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9e7f2-4e20-418b-867b-ef1ea502325c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:31.043304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e7f2-4e20-418b-867b-ef1ea502325c service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:31.043579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e7f2-4e20-418b-867b-ef1ea502325c service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:31.043850 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9e7f2-4e20-418b-867b-ef1ea502325c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:31.045490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d5d9e7f2-4e20-418b-867b-ef1ea502325c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:31.145571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9e7f2-4e20-418b-867b-ef1ea502325c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:31.147185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9e7f2-4e20-418b-867b-ef1ea502325c service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:31.164769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 534/1096] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:32.281113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339076f-50c5-4084-aed8-76eafd27179b None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:32.281697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339076f-50c5-4084-aed8-76eafd27179b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:32.281697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339076f-50c5-4084-aed8-76eafd27179b None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:32.283069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 563/1097] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:32.289205 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a5017-825b-4f57-9476-d8a1aec00007 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:32.289887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a5017-825b-4f57-9476-d8a1aec00007 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:32.290042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a5017-825b-4f57-9476-d8a1aec00007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:32.352405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:32.376085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-649a5017-825b-4f57-9476-d8a1aec00007 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:32.377298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-649a5017-825b-4f57-9476-d8a1aec00007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:32.479851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 535/1098] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:32.632118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339076f-50c5-4084-aed8-76eafd27179b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:32.634903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5339076f-50c5-4084-aed8-76eafd27179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:32.785607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339076f-50c5-4084-aed8-76eafd27179b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:32.797893 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:32.910753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862503f-61bf-4135-b36e-54069eca381a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:32.911339 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862503f-61bf-4135-b36e-54069eca381a service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:32.911618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862503f-61bf-4135-b36e-54069eca381a service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:32.911891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862503f-61bf-4135-b36e-54069eca381a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:32.913534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c862503f-61bf-4135-b36e-54069eca381a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:33.007891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862503f-61bf-4135-b36e-54069eca381a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:33.009491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862503f-61bf-4135-b36e-54069eca381a service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:33.028318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 564/1099] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:34.119557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bf4e-0ff3-4795-9999-962096c877d7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:34.120098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bf4e-0ff3-4795-9999-962096c877d7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:34.120098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bf4e-0ff3-4795-9999-962096c877d7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:34.121397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 536/1100] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:34.127529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb6296-1610-4369-b6c3-13db6612a3cc None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:34.128228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb6296-1610-4369-b6c3-13db6612a3cc None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:34.128379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb6296-1610-4369-b6c3-13db6612a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:34.151593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:34.208142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-30eb6296-1610-4369-b6c3-13db6612a3cc None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:34.209340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-30eb6296-1610-4369-b6c3-13db6612a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:34.305938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 565/1101] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:34.462506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79bf4e-0ff3-4795-9999-962096c877d7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:34.464266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cc79bf4e-0ff3-4795-9999-962096c877d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:34.580657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:34.616553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79bf4e-0ff3-4795-9999-962096c877d7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:34.735024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f07a1-0386-4b1a-b6fc-195f1ea286f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:34.735640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f07a1-0386-4b1a-b6fc-195f1ea286f2 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:34.735921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f07a1-0386-4b1a-b6fc-195f1ea286f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:34.736188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f07a1-0386-4b1a-b6fc-195f1ea286f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:34.737791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4e3f07a1-0386-4b1a-b6fc-195f1ea286f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:34.817792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:34.832813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f07a1-0386-4b1a-b6fc-195f1ea286f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:34.834467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f07a1-0386-4b1a-b6fc-195f1ea286f2 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:34.854093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 537/1102] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:35.949360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb4ff-8321-4eec-b1bf-25cc3ee2ad68 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:35.950274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb4ff-8321-4eec-b1bf-25cc3ee2ad68 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:35.950274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb4ff-8321-4eec-b1bf-25cc3ee2ad68 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:35.952403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 566/1103] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:17:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:35.960803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb77d4d-fd04-4ba8-952a-76206f3c97ce None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:35.961224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb77d4d-fd04-4ba8-952a-76206f3c97ce None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:35.961370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb77d4d-fd04-4ba8-952a-76206f3c97ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:36.048306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6eb77d4d-fd04-4ba8-952a-76206f3c97ce None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:36.049528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6eb77d4d-fd04-4ba8-952a-76206f3c97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:36.161340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 538/1104] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:36.313708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bb4ff-8321-4eec-b1bf-25cc3ee2ad68 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:36.316465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-db2bb4ff-8321-4eec-b1bf-25cc3ee2ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:36.407869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:36.473594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bb4ff-8321-4eec-b1bf-25cc3ee2ad68 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:36.602282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8bb88-448e-4a8c-bd1d-7b2d9638222f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:36.602920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8bb88-448e-4a8c-bd1d-7b2d9638222f service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:36.603206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8bb88-448e-4a8c-bd1d-7b2d9638222f service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:36.603484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8bb88-448e-4a8c-bd1d-7b2d9638222f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:36.605110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9dd8bb88-448e-4a8c-bd1d-7b2d9638222f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:36.655932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:36.700632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8bb88-448e-4a8c-bd1d-7b2d9638222f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:36.702260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8bb88-448e-4a8c-bd1d-7b2d9638222f service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:36.720168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 567/1105] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:37.771862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c0b7-36fb-4736-8541-bde0ba11f060 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:37.772331 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c0b7-36fb-4736-8541-bde0ba11f060 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:37.772434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c0b7-36fb-4736-8541-bde0ba11f060 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:37.774663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 539/1106] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:17:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:37.779862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e48e6-8738-4e11-bb03-8e3a322727f3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:37.780309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e48e6-8738-4e11-bb03-8e3a322727f3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:37.780403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e48e6-8738-4e11-bb03-8e3a322727f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:37.858212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-075e48e6-8738-4e11-bb03-8e3a322727f3 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:37.859471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-075e48e6-8738-4e11-bb03-8e3a322727f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:37.968775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 568/1107] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:38.120093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365c0b7-36fb-4736-8541-bde0ba11f060 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:38.121740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c365c0b7-36fb-4736-8541-bde0ba11f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:38.172685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:38.277335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365c0b7-36fb-4736-8541-bde0ba11f060 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:38.395177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1550281-cc6a-40a1-9d91-2fc696e079d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:38.395814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1550281-cc6a-40a1-9d91-2fc696e079d1 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:38.396064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1550281-cc6a-40a1-9d91-2fc696e079d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:38.396337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1550281-cc6a-40a1-9d91-2fc696e079d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:38.397903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f1550281-cc6a-40a1-9d91-2fc696e079d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:38.404956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:38.496893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1550281-cc6a-40a1-9d91-2fc696e079d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:38.498480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1550281-cc6a-40a1-9d91-2fc696e079d1 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:38.517790 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 540/1108] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:39.556141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccbf75-cf45-4002-8c0d-654562243f1f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:39.556741 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccbf75-cf45-4002-8c0d-654562243f1f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:39.556741 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccbf75-cf45-4002-8c0d-654562243f1f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:39.557961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 569/1109] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:39.564340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abb12-30fc-4a3a-b7e8-93af93672fbc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:39.564771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abb12-30fc-4a3a-b7e8-93af93672fbc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:39.564864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abb12-30fc-4a3a-b7e8-93af93672fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:39.655515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b13abb12-30fc-4a3a-b7e8-93af93672fbc None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:39.656731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b13abb12-30fc-4a3a-b7e8-93af93672fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:39.727126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:39.758220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 541/1110] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:39.911578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccbf75-cf45-4002-8c0d-654562243f1f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:39.913095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-76ccbf75-cf45-4002-8c0d-654562243f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:39.934537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:40.075534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccbf75-cf45-4002-8c0d-654562243f1f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:40.167752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:40.194313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15327fee-d656-418e-9582-efb8287e01c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:40.194969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15327fee-d656-418e-9582-efb8287e01c9 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:40.195238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15327fee-d656-418e-9582-efb8287e01c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:40.195501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15327fee-d656-418e-9582-efb8287e01c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:40.197141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-15327fee-d656-418e-9582-efb8287e01c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:40.300441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15327fee-d656-418e-9582-efb8287e01c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:40.302025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15327fee-d656-418e-9582-efb8287e01c9 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:40.320401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 570/1111] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:41.348555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cc284-868a-4235-9494-f718426b1142 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:41.349193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cc284-868a-4235-9494-f718426b1142 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:41.349193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cc284-868a-4235-9494-f718426b1142 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:41.350489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 542/1112] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:41.356451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cff76-5f71-48fb-a9a8-337d7e7409b4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:41.356914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cff76-5f71-48fb-a9a8-337d7e7409b4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:41.357010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cff76-5f71-48fb-a9a8-337d7e7409b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:41.438436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cf9cff76-5f71-48fb-a9a8-337d7e7409b4 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:41.439686 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cf9cff76-5f71-48fb-a9a8-337d7e7409b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:41.482437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:41.539932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 571/1113] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:17:41.687568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cc284-868a-4235-9494-f718426b1142 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:41.689014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-012cc284-868a-4235-9494-f718426b1142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:41.842963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cc284-868a-4235-9494-f718426b1142 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:41.899869 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:41.968527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17cf3e-0914-442d-8338-838c809b67df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:41.969151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17cf3e-0914-442d-8338-838c809b67df service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:41.969431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17cf3e-0914-442d-8338-838c809b67df service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:41.969708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17cf3e-0914-442d-8338-838c809b67df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:41.971382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cf17cf3e-0914-442d-8338-838c809b67df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:42.066038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17cf3e-0914-442d-8338-838c809b67df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:42.067646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17cf3e-0914-442d-8338-838c809b67df service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:42.085979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 543/1114] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:43.120294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd37a3-63ff-4f90-a4e7-1854e2f15621 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:43.121164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd37a3-63ff-4f90-a4e7-1854e2f15621 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:43.121164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd37a3-63ff-4f90-a4e7-1854e2f15621 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:43.123258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 572/1115] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:17:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:43.129182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10608a-a922-4a2a-9e04-8f20a9213aa7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:43.129611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10608a-a922-4a2a-9e04-8f20a9213aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:43.129783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10608a-a922-4a2a-9e04-8f20a9213aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:43.211038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5f10608a-a922-4a2a-9e04-8f20a9213aa7 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:43.212257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5f10608a-a922-4a2a-9e04-8f20a9213aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:43.214263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:43.323106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 544/1116] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:43.471968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd37a3-63ff-4f90-a4e7-1854e2f15621 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:43.473485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a6fd37a3-63ff-4f90-a4e7-1854e2f15621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:43.651179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd37a3-63ff-4f90-a4e7-1854e2f15621 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:43.681060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:43.769032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b40224-e552-4986-b71e-907792be7e75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:43.769652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b40224-e552-4986-b71e-907792be7e75 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:43.769928 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b40224-e552-4986-b71e-907792be7e75 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:43.770193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b40224-e552-4986-b71e-907792be7e75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:43.771823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-46b40224-e552-4986-b71e-907792be7e75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:43.863292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b40224-e552-4986-b71e-907792be7e75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:43.864878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b40224-e552-4986-b71e-907792be7e75 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:43.883058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 573/1117] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:45.943021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916c4a0-970a-452e-a0ba-cd5ab3ffd222 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:45.943992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916c4a0-970a-452e-a0ba-cd5ab3ffd222 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:45.943992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916c4a0-970a-452e-a0ba-cd5ab3ffd222 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:45.946224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 545/1118] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:17:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:45.952513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566878a9-0c2b-44fe-bc0e-ab909a57e464 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:45.953011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566878a9-0c2b-44fe-bc0e-ab909a57e464 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:45.953118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566878a9-0c2b-44fe-bc0e-ab909a57e464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:46.004476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:46.033290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-566878a9-0c2b-44fe-bc0e-ab909a57e464 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:46.034507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-566878a9-0c2b-44fe-bc0e-ab909a57e464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:46.134148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 574/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:46.420193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916c4a0-970a-452e-a0ba-cd5ab3ffd222 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:46.422587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a916c4a0-970a-452e-a0ba-cd5ab3ffd222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:46.543852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916c4a0-970a-452e-a0ba-cd5ab3ffd222 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:46.578114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:46.622162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d759a5-cbe0-4775-b24a-46eb920d7a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:46.622758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d759a5-cbe0-4775-b24a-46eb920d7a3a service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:46.623069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d759a5-cbe0-4775-b24a-46eb920d7a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:46.623364 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d759a5-cbe0-4775-b24a-46eb920d7a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:46.624953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a4d759a5-cbe0-4775-b24a-46eb920d7a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:46.738437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d759a5-cbe0-4775-b24a-46eb920d7a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:46.739887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d759a5-cbe0-4775-b24a-46eb920d7a3a service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:46.759714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 546/1120] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:49.039113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87380d-563b-4c6e-8a3b-acdc67d6f96d None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:49.040010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87380d-563b-4c6e-8a3b-acdc67d6f96d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:49.040010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87380d-563b-4c6e-8a3b-acdc67d6f96d None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:49.042182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 575/1121] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:17:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:49.047769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a39d1-9395-4f29-b7a3-b24c2f9f6e1d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:49.048248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a39d1-9395-4f29-b7a3-b24c2f9f6e1d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:49.048350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a39d1-9395-4f29-b7a3-b24c2f9f6e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:49.119449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-432a39d1-9395-4f29-b7a3-b24c2f9f6e1d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:49.120582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-432a39d1-9395-4f29-b7a3-b24c2f9f6e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:49.138031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:49.228265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 547/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:49.510028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87380d-563b-4c6e-8a3b-acdc67d6f96d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:49.512422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7f87380d-563b-4c6e-8a3b-acdc67d6f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:49.630659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87380d-563b-4c6e-8a3b-acdc67d6f96d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:49.644923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:49.717165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200b664-dbea-4b7e-a105-ce8be822ff15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:49.717882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b664-dbea-4b7e-a105-ce8be822ff15 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:49.718160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b664-dbea-4b7e-a105-ce8be822ff15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:49.718423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b664-dbea-4b7e-a105-ce8be822ff15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:49.720042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3200b664-dbea-4b7e-a105-ce8be822ff15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:49.831095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200b664-dbea-4b7e-a105-ce8be822ff15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:49.832526 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200b664-dbea-4b7e-a105-ce8be822ff15 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:49.854869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 576/1123] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:52.339623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f8ef6-91a0-416a-8309-5b686f58d62e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:52.340287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f8ef6-91a0-416a-8309-5b686f58d62e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:52.340287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f8ef6-91a0-416a-8309-5b686f58d62e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:52.342147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 548/1124] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:17:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:52.350523 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab67ce-c8f7-4f24-81f0-ecb0f00de017 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:52.350948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab67ce-c8f7-4f24-81f0-ecb0f00de017 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:52.351090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab67ce-c8f7-4f24-81f0-ecb0f00de017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:52.401808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:52.421211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-06ab67ce-c8f7-4f24-81f0-ecb0f00de017 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:52.422433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-06ab67ce-c8f7-4f24-81f0-ecb0f00de017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:52.528483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 577/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:52.812007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f8ef6-91a0-416a-8309-5b686f58d62e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:52.814447 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-295f8ef6-91a0-416a-8309-5b686f58d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:52.930117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f8ef6-91a0-416a-8309-5b686f58d62e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:52.973228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:53.011021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a1d95-d618-4d2e-b51d-6dbb972c8afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:53.011640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1d95-d618-4d2e-b51d-6dbb972c8afe service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:53.011915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1d95-d618-4d2e-b51d-6dbb972c8afe service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:53.012184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1d95-d618-4d2e-b51d-6dbb972c8afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:53.013768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-af9a1d95-d618-4d2e-b51d-6dbb972c8afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:53.141162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a1d95-d618-4d2e-b51d-6dbb972c8afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:53.143038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a1d95-d618-4d2e-b51d-6dbb972c8afe service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:53.163401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 549/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:55.419367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df495d-99ae-4759-b6da-5c4caeb455e2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:55.420244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df495d-99ae-4759-b6da-5c4caeb455e2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:55.420355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df495d-99ae-4759-b6da-5c4caeb455e2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:55.422582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 578/1127] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:17:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:55.429499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2dc1b-58ee-4f49-9b79-10087e4b4bc1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:55.429952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2dc1b-58ee-4f49-9b79-10087e4b4bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:55.430054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2dc1b-58ee-4f49-9b79-10087e4b4bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:55.507413 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-33f2dc1b-58ee-4f49-9b79-10087e4b4bc1 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:55.508735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-33f2dc1b-58ee-4f49-9b79-10087e4b4bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:55.537487 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:55.632858 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 550/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:55.915634 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df495d-99ae-4759-b6da-5c4caeb455e2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:55.917231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-42df495d-99ae-4759-b6da-5c4caeb455e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:56.027755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df495d-99ae-4759-b6da-5c4caeb455e2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:56.051333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:56.109570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36161c48-45d2-444b-868e-fa78d2bea6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:56.110108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36161c48-45d2-444b-868e-fa78d2bea6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:56.110385 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36161c48-45d2-444b-868e-fa78d2bea6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:56.110655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36161c48-45d2-444b-868e-fa78d2bea6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:56.112274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-36161c48-45d2-444b-868e-fa78d2bea6d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:56.229950 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36161c48-45d2-444b-868e-fa78d2bea6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:56.231422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36161c48-45d2-444b-868e-fa78d2bea6d3 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:56.250255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 579/1129] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:58.430554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c42df-1154-4ae8-8abe-e3f13ac3938a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:58.431153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c42df-1154-4ae8-8abe-e3f13ac3938a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:58.431153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c42df-1154-4ae8-8abe-e3f13ac3938a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:58.432405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 551/1130] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:58.438641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fba89-3e25-4324-8238-2a86558cca4a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:58.439452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fba89-3e25-4324-8238-2a86558cca4a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:58.439558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fba89-3e25-4324-8238-2a86558cca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:58.515921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:58.518837 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d45fba89-3e25-4324-8238-2a86558cca4a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:58.520774 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d45fba89-3e25-4324-8238-2a86558cca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:58.625724 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 580/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:58.908761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c42df-1154-4ae8-8abe-e3f13ac3938a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:58.911180 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bf7c42df-1154-4ae8-8abe-e3f13ac3938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:59.034098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c42df-1154-4ae8-8abe-e3f13ac3938a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:59.087733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:59.114042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b760c4-bbdd-4932-b447-2ff2690c5125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:59.114581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b760c4-bbdd-4932-b447-2ff2690c5125 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:59.114900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b760c4-bbdd-4932-b447-2ff2690c5125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:59.115176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b760c4-bbdd-4932-b447-2ff2690c5125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:59.116770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2b760c4-bbdd-4932-b447-2ff2690c5125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:59.233147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b760c4-bbdd-4932-b447-2ff2690c5125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:59.234573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b760c4-bbdd-4932-b447-2ff2690c5125 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:59.253298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 552/1132] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:01.428988 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a791-c000-419d-a0cd-f7efc29a05a1 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:01.429505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a791-c000-419d-a0cd-f7efc29a05a1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:01.429505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a791-c000-419d-a0cd-f7efc29a05a1 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:01.430955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 581/1133] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:01.436739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb6f9b-9f6f-44ed-af43-a7281419b6c2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:01.437190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb6f9b-9f6f-44ed-af43-a7281419b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:01.437291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb6f9b-9f6f-44ed-af43-a7281419b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:01.504431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6efb6f9b-9f6f-44ed-af43-a7281419b6c2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:01.505622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6efb6f9b-9f6f-44ed-af43-a7281419b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:01.537194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:01.608887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 553/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:18:01.891021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a791-c000-419d-a0cd-f7efc29a05a1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:01.893393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ded5a791-c000-419d-a0cd-f7efc29a05a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:02.003801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a791-c000-419d-a0cd-f7efc29a05a1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:02.033813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:02.085452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9206a5a-6e35-4aa7-b225-289bb9de2173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:02.086070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9206a5a-6e35-4aa7-b225-289bb9de2173 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:02.086350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9206a5a-6e35-4aa7-b225-289bb9de2173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:02.086620 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9206a5a-6e35-4aa7-b225-289bb9de2173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:02.088252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c9206a5a-6e35-4aa7-b225-289bb9de2173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:02.209593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9206a5a-6e35-4aa7-b225-289bb9de2173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:02.211057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9206a5a-6e35-4aa7-b225-289bb9de2173 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:02.229157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 582/1135] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:04.505755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bb671-ed87-41bc-8246-7ac1ae256d4c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:04.506343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bb671-ed87-41bc-8246-7ac1ae256d4c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:04.506343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bb671-ed87-41bc-8246-7ac1ae256d4c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:04.507678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 554/1136] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:04.514192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede5b5a-3a9c-4748-ab77-1fb16546a5ac None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:04.514702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede5b5a-3a9c-4748-ab77-1fb16546a5ac None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:04.514848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede5b5a-3a9c-4748-ab77-1fb16546a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:04.594577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8ede5b5a-3a9c-4748-ab77-1fb16546a5ac None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:04.595833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8ede5b5a-3a9c-4748-ab77-1fb16546a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:04.604348 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:04.695650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 583/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:04.972094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bb671-ed87-41bc-8246-7ac1ae256d4c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:04.974499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e89bb671-ed87-41bc-8246-7ac1ae256d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:05.081491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bb671-ed87-41bc-8246-7ac1ae256d4c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:05.139308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:05.157617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655db656-0df2-41a9-96c1-7b1a5ea92830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:05.158219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655db656-0df2-41a9-96c1-7b1a5ea92830 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:05.158491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655db656-0df2-41a9-96c1-7b1a5ea92830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:05.158753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655db656-0df2-41a9-96c1-7b1a5ea92830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:05.160357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-655db656-0df2-41a9-96c1-7b1a5ea92830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:05.276441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655db656-0df2-41a9-96c1-7b1a5ea92830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:05.277854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655db656-0df2-41a9-96c1-7b1a5ea92830 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:05.296056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 555/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:07.494637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797318d-9251-4df3-b7e9-9453b500f287 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:07.495244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797318d-9251-4df3-b7e9-9453b500f287 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:07.495244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797318d-9251-4df3-b7e9-9453b500f287 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:07.497387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 584/1139] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:18:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:07.503195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15e5c9-3896-4547-bc43-297325763240 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:07.503693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15e5c9-3896-4547-bc43-297325763240 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:07.503693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15e5c9-3896-4547-bc43-297325763240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:07.578043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8d15e5c9-3896-4547-bc43-297325763240 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:07.579297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8d15e5c9-3896-4547-bc43-297325763240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:07.620756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:07.688398 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 556/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:18:07.977193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797318d-9251-4df3-b7e9-9453b500f287 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:07.979755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3797318d-9251-4df3-b7e9-9453b500f287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:08.108272 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797318d-9251-4df3-b7e9-9453b500f287 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:08.148053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:08.185402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b342ee-2075-4f8d-9077-46f157e0f6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:08.186009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b342ee-2075-4f8d-9077-46f157e0f6dc service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:08.186289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b342ee-2075-4f8d-9077-46f157e0f6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:08.186557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b342ee-2075-4f8d-9077-46f157e0f6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:08.188184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-15b342ee-2075-4f8d-9077-46f157e0f6dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:08.298737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b342ee-2075-4f8d-9077-46f157e0f6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:08.300072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b342ee-2075-4f8d-9077-46f157e0f6dc service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:08.318137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 585/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:10.501816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990de9-5773-4c1f-a83b-9fe7d5500130 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:10.502422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990de9-5773-4c1f-a83b-9fe7d5500130 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:10.502422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990de9-5773-4c1f-a83b-9fe7d5500130 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:10.503747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 557/1142] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:10.510564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc7dd3-52e0-4436-9977-fb9f083db79c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:10.511322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc7dd3-52e0-4436-9977-fb9f083db79c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:10.511472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc7dd3-52e0-4436-9977-fb9f083db79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:10.587453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-69dc7dd3-52e0-4436-9977-fb9f083db79c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:10.588670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-69dc7dd3-52e0-4436-9977-fb9f083db79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:10.607182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:10.687519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 586/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:10.965323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81990de9-5773-4c1f-a83b-9fe7d5500130 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:10.967021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-81990de9-5773-4c1f-a83b-9fe7d5500130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:11.088697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81990de9-5773-4c1f-a83b-9fe7d5500130 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:11.165626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:11.173396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf975a-fc9d-4a5c-be7e-37b36224fac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:11.174014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf975a-fc9d-4a5c-be7e-37b36224fac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:11.174289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf975a-fc9d-4a5c-be7e-37b36224fac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:11.174559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf975a-fc9d-4a5c-be7e-37b36224fac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:11.176216 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3ddf975a-fc9d-4a5c-be7e-37b36224fac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:11.293583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf975a-fc9d-4a5c-be7e-37b36224fac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:11.295171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf975a-fc9d-4a5c-be7e-37b36224fac5 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:11.314426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 558/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:18:13.433247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893014-4257-4e3f-abea-82a0cb9822e3 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:13.433733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893014-4257-4e3f-abea-82a0cb9822e3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:13.433840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893014-4257-4e3f-abea-82a0cb9822e3 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:13.435324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 587/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:13.440771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9999a9-def6-465b-b2ca-cd96fc3b7ee2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:13.441237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9999a9-def6-465b-b2ca-cd96fc3b7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:13.441348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9999a9-def6-465b-b2ca-cd96fc3b7ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:13.517823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9d9999a9-def6-465b-b2ca-cd96fc3b7ee2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:13.519143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9d9999a9-def6-465b-b2ca-cd96fc3b7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:13.577891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:13.628434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 559/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:13.907649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893014-4257-4e3f-abea-82a0cb9822e3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:13.909194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-18893014-4257-4e3f-abea-82a0cb9822e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:14.014481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893014-4257-4e3f-abea-82a0cb9822e3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:14.067569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:14.101933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c3470-366a-4fc8-938b-2ad706ff376e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:14.102461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3470-366a-4fc8-938b-2ad706ff376e service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:14.102816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3470-366a-4fc8-938b-2ad706ff376e service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:14.103009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3470-366a-4fc8-938b-2ad706ff376e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:14.104614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e82c3470-366a-4fc8-938b-2ad706ff376e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:14.224133 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c3470-366a-4fc8-938b-2ad706ff376e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:14.225578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c3470-366a-4fc8-938b-2ad706ff376e service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:14.244842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 588/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:23.626783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=22 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:24.242232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=66 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:33.870263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab07dcf-de02-44ae-9f0e-82298fcc76fd None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:33.870797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab07dcf-de02-44ae-9f0e-82298fcc76fd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:33.870906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab07dcf-de02-44ae-9f0e-82298fcc76fd None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:33.872297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 560/1148] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:33.877970 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecefd9-9d78-49b0-80c6-d2797629cb8b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:33.878409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecefd9-9d78-49b0-80c6-d2797629cb8b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:33.878547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecefd9-9d78-49b0-80c6-d2797629cb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:33.946240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-78ecefd9-9d78-49b0-80c6-d2797629cb8b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:33.947475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-78ecefd9-9d78-49b0-80c6-d2797629cb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:34.045230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 589/1149] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:34.350920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e58f65-0a90-4ae7-9668-85ee9289621c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:34.351307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e58f65-0a90-4ae7-9668-85ee9289621c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:34.351696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e58f65-0a90-4ae7-9668-85ee9289621c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:34.353870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 561/1150] 10.222.0.23 () {54 vars in 962 bytes} [Thu Oct 27 01:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:34.361402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b5c59-45bd-49ac-9eeb-64aa172305a9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:34.361801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b5c59-45bd-49ac-9eeb-64aa172305a9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:34.362082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b5c59-45bd-49ac-9eeb-64aa172305a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:34.440966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-df3b5c59-45bd-49ac-9eeb-64aa172305a9 None None] MFA Rules not processed for user `0ea18d542ca24e39ac758f34ad65e7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:34.442134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-df3b5c59-45bd-49ac-9eeb-64aa172305a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:34.467460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:34.524025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 590/1151] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Oct 27 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:18:34.532275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e58f65-0a90-4ae7-9668-85ee9289621c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:34.533846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-29e58f65-0a90-4ae7-9668-85ee9289621c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:34.649368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e58f65-0a90-4ae7-9668-85ee9289621c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:34.724661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fdbf6-7035-4644-9b64-ed1dba7c72a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ea18d542ca24e39ac758f34ad65e7bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:34.725267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fdbf6-7035-4644-9b64-ed1dba7c72a5 service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:34.725541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fdbf6-7035-4644-9b64-ed1dba7c72a5 service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:34.725807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fdbf6-7035-4644-9b64-ed1dba7c72a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:34.727421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a06fdbf6-7035-4644-9b64-ed1dba7c72a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:34.783817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:34.845283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fdbf6-7035-4644-9b64-ed1dba7c72a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:34.846748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fdbf6-7035-4644-9b64-ed1dba7c72a5 service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:34.866891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 562/1152] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:37.090882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150041d-99e0-4ad0-bd40-5c4d6a988c88 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:37.091699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150041d-99e0-4ad0-bd40-5c4d6a988c88 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:37.091699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150041d-99e0-4ad0-bd40-5c4d6a988c88 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:37.093138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 591/1153] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:37.099515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461fd08-3dd4-4d92-ae57-82bdf5086456 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:37.099954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461fd08-3dd4-4d92-ae57-82bdf5086456 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:37.100057 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461fd08-3dd4-4d92-ae57-82bdf5086456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:37.178499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a461fd08-3dd4-4d92-ae57-82bdf5086456 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:37.179770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a461fd08-3dd4-4d92-ae57-82bdf5086456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:37.283372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 563/1154] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:37.548457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150041d-99e0-4ad0-bd40-5c4d6a988c88 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:37.549989 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c150041d-99e0-4ad0-bd40-5c4d6a988c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:37.683249 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150041d-99e0-4ad0-bd40-5c4d6a988c88 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:37.740056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:37.785228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a441535-32b9-483a-b42c-564aa0bca3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:37.785867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a441535-32b9-483a-b42c-564aa0bca3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:37.786145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a441535-32b9-483a-b42c-564aa0bca3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:37.786439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a441535-32b9-483a-b42c-564aa0bca3d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:37.787090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a441535-32b9-483a-b42c-564aa0bca3d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:37.788196 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-1a441535-32b9-483a-b42c-564aa0bca3d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:18:37.788196 dv-cinder-815582-19-smb devstack@keystone.service[81616]: warnings.warn(msg) Oct 27 01:18:37.788196 dv-cinder-815582-19-smb devstack@keystone.service[81616]: Oct 27 01:18:37.789336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a441535-32b9-483a-b42c-564aa0bca3d0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:37.812413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 592/1155] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Oct 27 01:18:37 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:18:39.979685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40cd7d-87cf-48f5-80f0-4979e4552c76 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:39.980546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40cd7d-87cf-48f5-80f0-4979e4552c76 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:39.980546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40cd7d-87cf-48f5-80f0-4979e4552c76 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:39.982643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 564/1156] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:18:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:39.988259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd97ffe-a792-4c33-b9af-3f282cb64bc3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:39.988700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd97ffe-a792-4c33-b9af-3f282cb64bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:39.988796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd97ffe-a792-4c33-b9af-3f282cb64bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:40.067180 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ffd97ffe-a792-4c33-b9af-3f282cb64bc3 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:40.068390 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ffd97ffe-a792-4c33-b9af-3f282cb64bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:40.164208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 593/1157] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:40.454440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40cd7d-87cf-48f5-80f0-4979e4552c76 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:40.456112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3e40cd7d-87cf-48f5-80f0-4979e4552c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:40.466563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:40.611042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40cd7d-87cf-48f5-80f0-4979e4552c76 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:40.693857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:40.727938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe12641-075f-483b-8c0a-16f73631fa32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:40.728543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12641-075f-483b-8c0a-16f73631fa32 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:40.728817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12641-075f-483b-8c0a-16f73631fa32 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:40.729081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12641-075f-483b-8c0a-16f73631fa32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:40.730660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9fe12641-075f-483b-8c0a-16f73631fa32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:40.820999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe12641-075f-483b-8c0a-16f73631fa32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:40.822571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe12641-075f-483b-8c0a-16f73631fa32 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:40.841349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 565/1158] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:43.140274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898c282-b1ee-49a9-874b-4a048fcc22b8 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:43.140840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898c282-b1ee-49a9-874b-4a048fcc22b8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:43.140840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898c282-b1ee-49a9-874b-4a048fcc22b8 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:43.142066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 594/1159] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:43.148854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fa40e-7d7c-44e5-897d-2baf90b48241 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:43.149602 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fa40e-7d7c-44e5-897d-2baf90b48241 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:43.149777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fa40e-7d7c-44e5-897d-2baf90b48241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:43.221285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a50fa40e-7d7c-44e5-897d-2baf90b48241 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:43.222508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a50fa40e-7d7c-44e5-897d-2baf90b48241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:43.272554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:43.326931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 566/1160] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:43.615708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898c282-b1ee-49a9-874b-4a048fcc22b8 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:43.617245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e898c282-b1ee-49a9-874b-4a048fcc22b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:43.641514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:43.723219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898c282-b1ee-49a9-874b-4a048fcc22b8 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:43.798747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0c0ab-1a49-4d8e-9e2c-bb1c51992422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:43.799427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0c0ab-1a49-4d8e-9e2c-bb1c51992422 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:43.799706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0c0ab-1a49-4d8e-9e2c-bb1c51992422 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:43.799986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0c0ab-1a49-4d8e-9e2c-bb1c51992422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:43.801565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c1f0c0ab-1a49-4d8e-9e2c-bb1c51992422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:43.886987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:43.923881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0c0ab-1a49-4d8e-9e2c-bb1c51992422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:43.925314 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0c0ab-1a49-4d8e-9e2c-bb1c51992422 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:43.944019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 595/1161] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:46.114077 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b3df-3771-4efa-94ea-4293de3fbde5 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:46.114947 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b3df-3771-4efa-94ea-4293de3fbde5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:46.114947 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b3df-3771-4efa-94ea-4293de3fbde5 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:46.117014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 567/1162] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:18:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:46.123507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23fca-82d9-4bdb-b3f0-2a1b6a5ed66c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:46.124292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23fca-82d9-4bdb-b3f0-2a1b6a5ed66c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:46.124458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23fca-82d9-4bdb-b3f0-2a1b6a5ed66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:46.198931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-51e23fca-82d9-4bdb-b3f0-2a1b6a5ed66c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:46.200149 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-51e23fca-82d9-4bdb-b3f0-2a1b6a5ed66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:46.312572 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 596/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:46.597752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b3df-3771-4efa-94ea-4293de3fbde5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:46.600350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e745b3df-3771-4efa-94ea-4293de3fbde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:46.716181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b3df-3771-4efa-94ea-4293de3fbde5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:46.798380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:46.799946 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc438c-c6f0-441b-bc00-b6316e992526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:46.800579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc438c-c6f0-441b-bc00-b6316e992526 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:46.800870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc438c-c6f0-441b-bc00-b6316e992526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:46.801346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc438c-c6f0-441b-bc00-b6316e992526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:46.803389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-25cc438c-c6f0-441b-bc00-b6316e992526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:46.922114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc438c-c6f0-441b-bc00-b6316e992526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:46.923591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc438c-c6f0-441b-bc00-b6316e992526 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:46.942629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 568/1164] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:49.227429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81069f9-1a14-4ad0-87e6-80a2b92bd47c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:49.228065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81069f9-1a14-4ad0-87e6-80a2b92bd47c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:49.228065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81069f9-1a14-4ad0-87e6-80a2b92bd47c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:49.229356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 597/1165] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:49.235904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c19eb-5f53-4236-930d-280433aa6344 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:49.236718 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c19eb-5f53-4236-930d-280433aa6344 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:49.236718 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c19eb-5f53-4236-930d-280433aa6344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:49.316963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-020c19eb-5f53-4236-930d-280433aa6344 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:49.318167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-020c19eb-5f53-4236-930d-280433aa6344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:49.380160 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:49.428712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 569/1166] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:49.720298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81069f9-1a14-4ad0-87e6-80a2b92bd47c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:49.722775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c81069f9-1a14-4ad0-87e6-80a2b92bd47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:49.764250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:49.835416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81069f9-1a14-4ad0-87e6-80a2b92bd47c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:49.917795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20e8cc-18aa-40e5-b293-af935a252162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:49.918314 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20e8cc-18aa-40e5-b293-af935a252162 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:49.918590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20e8cc-18aa-40e5-b293-af935a252162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:49.918917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20e8cc-18aa-40e5-b293-af935a252162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:49.920506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2f20e8cc-18aa-40e5-b293-af935a252162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:50.008579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:50.039140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20e8cc-18aa-40e5-b293-af935a252162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:50.040598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20e8cc-18aa-40e5-b293-af935a252162 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:50.059627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 598/1167] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:18:52.400067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da39efc-3c32-4b65-a91f-c02985864cba None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:52.400690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da39efc-3c32-4b65-a91f-c02985864cba None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:52.400690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da39efc-3c32-4b65-a91f-c02985864cba None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:52.401971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 570/1168] 10.222.0.23 () {54 vars in 927 bytes} [Thu Oct 27 01:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:18:52.408588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cdd21-fc5a-4039-abe1-e472bf62fc28 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:52.409276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cdd21-fc5a-4039-abe1-e472bf62fc28 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:52.409524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cdd21-fc5a-4039-abe1-e472bf62fc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:52.486553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-983cdd21-fc5a-4039-abe1-e472bf62fc28 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:18:52.487826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-983cdd21-fc5a-4039-abe1-e472bf62fc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:52.598824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 599/1169] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Oct 27 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:18:52.880854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da39efc-3c32-4b65-a91f-c02985864cba None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:18:52.882882 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9da39efc-3c32-4b65-a91f-c02985864cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:52.997195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da39efc-3c32-4b65-a91f-c02985864cba None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:18:53.076167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f0ad6-18b3-47d6-a5f1-b185ee1ef53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:18:53.076763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0ad6-18b3-47d6-a5f1-b185ee1ef53a service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:18:53.077031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0ad6-18b3-47d6-a5f1-b185ee1ef53a service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:18:53.077322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0ad6-18b3-47d6-a5f1-b185ee1ef53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:18:53.079398 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a68f0ad6-18b3-47d6-a5f1-b185ee1ef53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:18:53.088072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:18:53.194673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f0ad6-18b3-47d6-a5f1-b185ee1ef53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:18:53.196153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f0ad6-18b3-47d6-a5f1-b185ee1ef53a service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:18:53.215071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 571/1170] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:02.597297 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=82 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:19:03.212587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=50 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:11.938307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e43ad-89bd-4741-a15f-b6a40a2f1330 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:11.939218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e43ad-89bd-4741-a15f-b6a40a2f1330 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:11.939218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e43ad-89bd-4741-a15f-b6a40a2f1330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.028628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c45e43ad-89bd-4741-a15f-b6a40a2f1330 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:12.029825 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c45e43ad-89bd-4741-a15f-b6a40a2f1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.128978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 600/1171] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:12.137556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bd933-954d-45de-86f6-8906b168f747 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.138061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bd933-954d-45de-86f6-8906b168f747 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.138163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bd933-954d-45de-86f6-8906b168f747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.223380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-576bd933-954d-45de-86f6-8906b168f747 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:12.224603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-576bd933-954d-45de-86f6-8906b168f747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.343422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 572/1172] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:12.348239 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e43ad-89bd-4741-a15f-b6a40a2f1330 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.349486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c45e43ad-89bd-4741-a15f-b6a40a2f1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.361530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e43ad-89bd-4741-a15f-b6a40a2f1330 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.426111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:12.462807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.463430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.463708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.464066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.464722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:12.465025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.466038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:12.466038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: warnings.warn(msg) Oct 27 01:20:12.466038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: Oct 27 01:20:12.466961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.478160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 601/1173] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:12.488198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bd933-954d-45de-86f6-8906b168f747 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.501093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bd933-954d-45de-86f6-8906b168f747 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.567428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:12.602357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.603015 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.603320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.603573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.604223 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.605372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:12.605372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: warnings.warn(msg) Oct 27 01:20:12.605372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: Oct 27 01:20:12.606596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.665137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 573/1174] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:20:12 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:12.669654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.671230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.705954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7527f29-9550-42b4-9377-7ac419509e68 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.801411 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.802026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.802305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.802575 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.803245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.804262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:12.804262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: warnings.warn(msg) Oct 27 01:20:12.804262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: Oct 27 01:20:12.805466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.850977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 602/1175] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:20:12 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:12.855431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.856945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.922221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4497449-e578-4480-8c64-364aee4c001a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.008275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:13.020777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f7c89-3595-46e1-96a5-c7bb913fee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.021405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f7c89-3595-46e1-96a5-c7bb913fee0e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.021693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f7c89-3595-46e1-96a5-c7bb913fee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.021962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f7c89-3595-46e1-96a5-c7bb913fee0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.022611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f7c89-3595-46e1-96a5-c7bb913fee0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.024253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f7c89-3595-46e1-96a5-c7bb913fee0e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.037378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 574/1176] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:13.041813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.043509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.055497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ccbb1-25d8-4da8-8049-330782d231d2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.082143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:13.154250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5de69-1bf2-41a7-afae-22beab75d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.154890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5de69-1bf2-41a7-afae-22beab75d076 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.155163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5de69-1bf2-41a7-afae-22beab75d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.155436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5de69-1bf2-41a7-afae-22beab75d076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.156078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5de69-1bf2-41a7-afae-22beab75d076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.157656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5de69-1bf2-41a7-afae-22beab75d076 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.171005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 603/1177] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:13.175651 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f7c89-3595-46e1-96a5-c7bb913fee0e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.177250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9f7f7c89-3595-46e1-96a5-c7bb913fee0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.212788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f7c89-3595-46e1-96a5-c7bb913fee0e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.312831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bbd15-6517-4558-8400-52f7a6e66860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.313421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bbd15-6517-4558-8400-52f7a6e66860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.313688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bbd15-6517-4558-8400-52f7a6e66860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.313949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bbd15-6517-4558-8400-52f7a6e66860 admin admin] PATH_INFO: `/v3/projects/224304d0d3b04beb8c3f767ac1696beb/users/1c68125422e84140852231c36375ed6d/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.343898 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bbd15-6517-4558-8400-52f7a6e66860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224304d0d3b04beb8c3f767ac1696beb, user_id=1c68125422e84140852231c36375ed6d, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.346561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bbd15-6517-4558-8400-52f7a6e66860 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.375210 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 575/1178] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:20:13 2022] PUT /identity/v3/projects/224304d0d3b04beb8c3f767ac1696beb/users/1c68125422e84140852231c36375ed6d/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:13.387159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810ec6c-8ac5-423f-bf0f-699a955bc58a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.387441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810ec6c-8ac5-423f-bf0f-699a955bc58a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.387721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810ec6c-8ac5-423f-bf0f-699a955bc58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.448661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8810ec6c-8ac5-423f-bf0f-699a955bc58a None None] MFA Rules not processed for user `1c68125422e84140852231c36375ed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:13.449896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8810ec6c-8ac5-423f-bf0f-699a955bc58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.531094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 604/1179] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:13.544603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c4ff7-2ccb-4b6d-9795-adf253eaec78 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.544924 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c4ff7-2ccb-4b6d-9795-adf253eaec78 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.545207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c4ff7-2ccb-4b6d-9795-adf253eaec78 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.546565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 576/1180] 10.222.0.23 () {54 vars in 963 bytes} [Thu Oct 27 01:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:13.551450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68909494-322e-4e62-9077-175d066e203f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.551729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68909494-322e-4e62-9077-175d066e203f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.552008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68909494-322e-4e62-9077-175d066e203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.583222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:13.629197 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-68909494-322e-4e62-9077-175d066e203f None None] MFA Rules not processed for user `095bc16a66c24f44939009ac95e2bc3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:13.630762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-68909494-322e-4e62-9077-175d066e203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.709501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 605/1181] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Oct 27 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:13.717434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c4ff7-2ccb-4b6d-9795-adf253eaec78 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.719121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-373c4ff7-2ccb-4b6d-9795-adf253eaec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.770459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:13.827785 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c4ff7-2ccb-4b6d-9795-adf253eaec78 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.907358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.907983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.908265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.908534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.910157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:14.015272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.016696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.020120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:14.035143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 577/1182] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:20:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:14.088674 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714351-b53c-4761-8bd1-4cc7d2ad7511 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.089137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714351-b53c-4761-8bd1-4cc7d2ad7511 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.089240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714351-b53c-4761-8bd1-4cc7d2ad7511 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.090581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 606/1183] 10.222.0.23 () {52 vars in 830 bytes} [Thu Oct 27 01:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:14.094315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.095655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:14.199101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb454-6dae-46df-a07c-8c2b3d812bee service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.300282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.300911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.301183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.301446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] PATH_INFO: `/v3/users/1c68125422e84140852231c36375ed6d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.314006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c68125422e84140852231c36375ed6d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.315065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:14.315065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: warnings.warn(msg) Oct 27 01:20:14.315065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: Oct 27 01:20:14.316252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.326880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:14.390047 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c68125422e84140852231c36375ed6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:14.404948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c68125422e84140852231c36375ed6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:14.429466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c68125422e84140852231c36375ed6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:14.441643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c68125422e84140852231c36375ed6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:14.442156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c68125422e84140852231c36375ed6d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:14.448105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 578/1184] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:20:14 2022] DELETE /identity/v3/users/1c68125422e84140852231c36375ed6d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:14.452723 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4df78-6e13-4b79-9438-b67412044fd6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.453006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4df78-6e13-4b79-9438-b67412044fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.453302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4df78-6e13-4b79-9438-b67412044fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.510812 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-18a4df78-6e13-4b79-9438-b67412044fd6 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:14.512087 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-18a4df78-6e13-4b79-9438-b67412044fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:14.594653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:14.607882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 607/1185] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:14.621565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.622836 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:14.732644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328567e-f02d-488d-b526-eef6f8213aa5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.794117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:14.816160 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea307b-fbea-415f-8f2e-a204e2c47136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.816777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea307b-fbea-415f-8f2e-a204e2c47136 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.817053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea307b-fbea-415f-8f2e-a204e2c47136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.817325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea307b-fbea-415f-8f2e-a204e2c47136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.818939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b1ea307b-fbea-415f-8f2e-a204e2c47136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:14.932022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea307b-fbea-415f-8f2e-a204e2c47136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.933454 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea307b-fbea-415f-8f2e-a204e2c47136 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.952291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 579/1186] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:15.326046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4df78-6e13-4b79-9438-b67412044fd6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:15.327410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-18a4df78-6e13-4b79-9438-b67412044fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:15.339011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4df78-6e13-4b79-9438-b67412044fd6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.439202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.439861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.440134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.440399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] PATH_INFO: `/v3/projects/224304d0d3b04beb8c3f767ac1696beb` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.451231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224304d0d3b04beb8c3f767ac1696beb)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:15.452257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:15.452257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: warnings.warn(msg) Oct 27 01:20:15.452257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: Oct 27 01:20:15.453484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:15.513552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224304d0d3b04beb8c3f767ac1696beb', 'request_id': 'req-729ad553-8daf-458b-972d-65a6913122a9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.520141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224304d0d3b04beb8c3f767ac1696beb', 'request_id': 'req-729ad553-8daf-458b-972d-65a6913122a9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.534857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224304d0d3b04beb8c3f767ac1696beb', 'request_id': 'req-729ad553-8daf-458b-972d-65a6913122a9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.562123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] The token cache is being invalidate because project 224304d0d3b04beb8c3f767ac1696beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:15.562413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.562964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-729ad553-8daf-458b-972d-65a6913122a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.564268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 608/1187] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:20:15 2022] DELETE /identity/v3/projects/224304d0d3b04beb8c3f767ac1696beb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:24.949887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=62 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:20:25.559906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:21:46.288780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0bf3-741c-4898-9826-e21e3f60789b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:46.289450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0bf3-741c-4898-9826-e21e3f60789b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:46.289450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0bf3-741c-4898-9826-e21e3f60789b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:46.291285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 580/1188] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:21:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:46.296339 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec76b-92a7-4405-8f9d-d16cea9db714 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:46.296791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec76b-92a7-4405-8f9d-d16cea9db714 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:46.296899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec76b-92a7-4405-8f9d-d16cea9db714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:46.381750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-eefec76b-92a7-4405-8f9d-d16cea9db714 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:46.382961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eefec76b-92a7-4405-8f9d-d16cea9db714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:46.500948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 609/1189] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:46.654917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0bf3-741c-4898-9826-e21e3f60789b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:46.658385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b68a0bf3-741c-4898-9826-e21e3f60789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:46.804085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0bf3-741c-4898-9826-e21e3f60789b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:46.809895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa06fb-9067-425e-b11e-21c8d0623f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:46.810524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa06fb-9067-425e-b11e-21c8d0623f1d service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:46.810831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa06fb-9067-425e-b11e-21c8d0623f1d service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:46.811107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa06fb-9067-425e-b11e-21c8d0623f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:46.819455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa06fb-9067-425e-b11e-21c8d0623f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:46.821048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa06fb-9067-425e-b11e-21c8d0623f1d service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:46.831122 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 581/1190] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:47.904172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e5b5-3f3a-442f-b2af-fbf0f39ddd81 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.904762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e5b5-3f3a-442f-b2af-fbf0f39ddd81 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.904762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e5b5-3f3a-442f-b2af-fbf0f39ddd81 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:47.906057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 610/1191] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:47.911147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96477-a64d-45c9-ad3d-6e40192d85ad None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.911598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96477-a64d-45c9-ad3d-6e40192d85ad None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.911697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96477-a64d-45c9-ad3d-6e40192d85ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:47.927914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f8f7-ec52-4206-9205-fcfe0eb438d8 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.928204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f8f7-ec52-4206-9205-fcfe0eb438d8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.928462 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f8f7-ec52-4206-9205-fcfe0eb438d8 None None] PATH_INFO: `/v3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:47.929700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 611/1192] 10.222.0.16 () {54 vars in 925 bytes} [Thu Oct 27 01:21:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:47.933159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-10d96477-a64d-45c9-ad3d-6e40192d85ad None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:47.934610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-10d96477-a64d-45c9-ad3d-6e40192d85ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:47.943689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 582/1193] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:47.945113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec5d14-1a09-4444-9d78-1c4f6e9becbb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.945397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec5d14-1a09-4444-9d78-1c4f6e9becbb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.945668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec5d14-1a09-4444-9d78-1c4f6e9becbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:48.007042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4fec5d14-1a09-4444-9d78-1c4f6e9becbb None None] MFA Rules not processed for user `bc32363c074f4418964ea46068a28831`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:48.008270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4fec5d14-1a09-4444-9d78-1c4f6e9becbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:48.038468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:21:48.079683 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 612/1194] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 27 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:48.094431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96477-a64d-45c9-ad3d-6e40192d85ad None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:48.107233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96477-a64d-45c9-ad3d-6e40192d85ad None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:48.113305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af4ada-4fd7-4087-b0e7-93343fa9844f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:48.113903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af4ada-4fd7-4087-b0e7-93343fa9844f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:48.114184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af4ada-4fd7-4087-b0e7-93343fa9844f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:48.114456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af4ada-4fd7-4087-b0e7-93343fa9844f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:48.122888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af4ada-4fd7-4087-b0e7-93343fa9844f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:48.124472 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af4ada-4fd7-4087-b0e7-93343fa9844f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:48.137704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 583/1195] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:56.923608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ea42e-c39d-411c-a67a-7d29dc04bd61 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:56.924151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ea42e-c39d-411c-a67a-7d29dc04bd61 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:56.924151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ea42e-c39d-411c-a67a-7d29dc04bd61 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:56.925505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 613/1196] 10.222.0.23 () {54 vars in 961 bytes} [Thu Oct 27 01:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:56.930893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ce17f-803c-41d9-8800-9767b03a9ce5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:56.931375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ce17f-803c-41d9-8800-9767b03a9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:56.931489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ce17f-803c-41d9-8800-9767b03a9ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:56.951561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d41ce17f-803c-41d9-8800-9767b03a9ce5 None None] MFA Rules not processed for user `bc32363c074f4418964ea46068a28831`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:56.952760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d41ce17f-803c-41d9-8800-9767b03a9ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:56.962772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 584/1197] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Oct 27 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:56.970486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ea42e-c39d-411c-a67a-7d29dc04bd61 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:56.985886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ea42e-c39d-411c-a67a-7d29dc04bd61 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:56.991557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb515f84-f399-4cbb-9adb-71d6dc93eafc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:56.992162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515f84-f399-4cbb-9adb-71d6dc93eafc service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:56.992442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515f84-f399-4cbb-9adb-71d6dc93eafc service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:56.992710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515f84-f399-4cbb-9adb-71d6dc93eafc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:57.001095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb515f84-f399-4cbb-9adb-71d6dc93eafc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:57.003078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb515f84-f399-4cbb-9adb-71d6dc93eafc service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:57.012670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 614/1198] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:21:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:59.605623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa3592-e438-416a-98df-7c1d35e1da4e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.606527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa3592-e438-416a-98df-7c1d35e1da4e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.606527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa3592-e438-416a-98df-7c1d35e1da4e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.608678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 585/1199] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:21:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:59.613748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fa7c9-30dc-40fa-96d8-b4914635f5a8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.614196 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fa7c9-30dc-40fa-96d8-b4914635f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.614309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fa7c9-30dc-40fa-96d8-b4914635f5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.635534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a25fa7c9-30dc-40fa-96d8-b4914635f5a8 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:59.636722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a25fa7c9-30dc-40fa-96d8-b4914635f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:59.645123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 615/1200] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:59.796502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa3592-e438-416a-98df-7c1d35e1da4e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:59.811851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa3592-e438-416a-98df-7c1d35e1da4e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:59.817396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5e431-6f65-4df9-99d3-f5d671192a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:59.817997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5e431-6f65-4df9-99d3-f5d671192a5e service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.818272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5e431-6f65-4df9-99d3-f5d671192a5e service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.818540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5e431-6f65-4df9-99d3-f5d671192a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.826915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5e431-6f65-4df9-99d3-f5d671192a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:59.828497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5e431-6f65-4df9-99d3-f5d671192a5e service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:59.838389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 586/1201] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:00.901318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278cba7-86ba-4e86-bd06-8ff3aeba1022 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:00.901870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278cba7-86ba-4e86-bd06-8ff3aeba1022 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:00.901870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278cba7-86ba-4e86-bd06-8ff3aeba1022 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:00.903242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 616/1202] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 01:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:00.909468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af852b-efa7-4568-8e40-58ac2ab2309f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:00.909892 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af852b-efa7-4568-8e40-58ac2ab2309f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:00.910024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af852b-efa7-4568-8e40-58ac2ab2309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:00.940418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-53af852b-efa7-4568-8e40-58ac2ab2309f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:00.941611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-53af852b-efa7-4568-8e40-58ac2ab2309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:00.950515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 587/1203] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 01:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:01.101944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278cba7-86ba-4e86-bd06-8ff3aeba1022 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:01.127675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278cba7-86ba-4e86-bd06-8ff3aeba1022 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:01.134512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3502fde-a224-4a02-a9b5-240174e6d857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:01.135148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3502fde-a224-4a02-a9b5-240174e6d857 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:01.135411 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3502fde-a224-4a02-a9b5-240174e6d857 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:01.135682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3502fde-a224-4a02-a9b5-240174e6d857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:01.144393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3502fde-a224-4a02-a9b5-240174e6d857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:01.145989 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3502fde-a224-4a02-a9b5-240174e6d857 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:01.155416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 617/1204] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:05.084913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f924a09-76b4-4cdf-97d2-0aec50f88cf7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:05.085480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f924a09-76b4-4cdf-97d2-0aec50f88cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:05.085480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f924a09-76b4-4cdf-97d2-0aec50f88cf7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:05.086863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 588/1205] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:05.093268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9a703-55d7-4bfa-adb9-623e1674dbb3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:05.094158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9a703-55d7-4bfa-adb9-623e1674dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:05.094158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9a703-55d7-4bfa-adb9-623e1674dbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:05.122281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-dcb9a703-55d7-4bfa-adb9-623e1674dbb3 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:05.123523 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dcb9a703-55d7-4bfa-adb9-623e1674dbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:05.133744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 618/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:22:05.423140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f924a09-76b4-4cdf-97d2-0aec50f88cf7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:05.425993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3f924a09-76b4-4cdf-97d2-0aec50f88cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:05.498742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:22:05.515751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f924a09-76b4-4cdf-97d2-0aec50f88cf7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:05.519752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaef2a-19ce-4ee4-bc3b-e72cda8868ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:05.520368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaef2a-19ce-4ee4-bc3b-e72cda8868ea service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:05.520647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaef2a-19ce-4ee4-bc3b-e72cda8868ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:05.520948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaef2a-19ce-4ee4-bc3b-e72cda8868ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:05.530959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdaef2a-19ce-4ee4-bc3b-e72cda8868ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:05.532484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdaef2a-19ce-4ee4-bc3b-e72cda8868ea service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:05.542346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 589/1207] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:07.674604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db739ef9-0b8b-43e7-a155-3dd2f2308f4b None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:07.675169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db739ef9-0b8b-43e7-a155-3dd2f2308f4b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:07.675169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db739ef9-0b8b-43e7-a155-3dd2f2308f4b None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:07.676620 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 619/1208] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:07.681998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aac19-3732-4b0b-9343-d4631f1ca940 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:07.682432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aac19-3732-4b0b-9343-d4631f1ca940 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:07.682548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aac19-3732-4b0b-9343-d4631f1ca940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:07.704728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f06aac19-3732-4b0b-9343-d4631f1ca940 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:07.706004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f06aac19-3732-4b0b-9343-d4631f1ca940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:07.715161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 590/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:08.017511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db739ef9-0b8b-43e7-a155-3dd2f2308f4b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:08.029845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db739ef9-0b8b-43e7-a155-3dd2f2308f4b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:08.034041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dff4d-98fd-4772-9537-40e9521510e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:08.034639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dff4d-98fd-4772-9537-40e9521510e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:08.034952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dff4d-98fd-4772-9537-40e9521510e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:08.035210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dff4d-98fd-4772-9537-40e9521510e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:08.044256 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108dff4d-98fd-4772-9537-40e9521510e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:08.045689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108dff4d-98fd-4772-9537-40e9521510e4 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:08.054954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 620/1210] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:11.622552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39142b-4e36-444b-ad91-7ec2da0c26df None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:11.623153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39142b-4e36-444b-ad91-7ec2da0c26df None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:11.623153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39142b-4e36-444b-ad91-7ec2da0c26df None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:11.624501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 591/1211] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:11.631185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a20d40-6bb2-43f8-a965-c0bbddcf4e24 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:11.631894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a20d40-6bb2-43f8-a965-c0bbddcf4e24 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:11.632025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a20d40-6bb2-43f8-a965-c0bbddcf4e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:11.662751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-97a20d40-6bb2-43f8-a965-c0bbddcf4e24 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:11.663980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-97a20d40-6bb2-43f8-a965-c0bbddcf4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:11.673498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 621/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:11.979843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39142b-4e36-444b-ad91-7ec2da0c26df None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:11.981924 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9e39142b-4e36-444b-ad91-7ec2da0c26df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:12.064410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39142b-4e36-444b-ad91-7ec2da0c26df None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:12.068273 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8a81a-a2c9-4db1-be91-bc14758c5608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:12.068918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8a81a-a2c9-4db1-be91-bc14758c5608 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:12.069200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8a81a-a2c9-4db1-be91-bc14758c5608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:12.069471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8a81a-a2c9-4db1-be91-bc14758c5608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:12.079329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8a81a-a2c9-4db1-be91-bc14758c5608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:12.080772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8a81a-a2c9-4db1-be91-bc14758c5608 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:12.090519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 592/1213] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:14.185842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e71a1-9021-4b14-b96a-0e5e7c35b257 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.186694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e71a1-9021-4b14-b96a-0e5e7c35b257 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.186694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e71a1-9021-4b14-b96a-0e5e7c35b257 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.188780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 622/1214] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 01:22:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:14.196862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18998ec-7f40-4e10-925b-17f567091e41 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.197338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18998ec-7f40-4e10-925b-17f567091e41 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.197433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18998ec-7f40-4e10-925b-17f567091e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.218067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e18998ec-7f40-4e10-925b-17f567091e41 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:14.219290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e18998ec-7f40-4e10-925b-17f567091e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:14.228980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 593/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 01:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:22:14.526036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e71a1-9021-4b14-b96a-0e5e7c35b257 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:14.529382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e54e71a1-9021-4b14-b96a-0e5e7c35b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:14.545426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e71a1-9021-4b14-b96a-0e5e7c35b257 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:14.549408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260fbeb-0771-45d7-a909-b922cfe5cc3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:14.550008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260fbeb-0771-45d7-a909-b922cfe5cc3a service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.550282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260fbeb-0771-45d7-a909-b922cfe5cc3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.550550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260fbeb-0771-45d7-a909-b922cfe5cc3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.561769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260fbeb-0771-45d7-a909-b922cfe5cc3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:14.564037 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260fbeb-0771-45d7-a909-b922cfe5cc3a service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:14.574284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 623/1216] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:24.213145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=50 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:22:24.570168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=50 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:41.966352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984942d-3e4f-40b4-a556-bd2064bf885d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:41.967033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984942d-3e4f-40b4-a556-bd2064bf885d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:41.967258 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984942d-3e4f-40b4-a556-bd2064bf885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:41.995637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a984942d-3e4f-40b4-a556-bd2064bf885d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:41.996864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a984942d-3e4f-40b4-a556-bd2064bf885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.011128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 594/1217] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:42.021838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fad492-3aac-472f-a349-ef2e626e35dd None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.023491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fad492-3aac-472f-a349-ef2e626e35dd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.023491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fad492-3aac-472f-a349-ef2e626e35dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.050466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-31fad492-3aac-472f-a349-ef2e626e35dd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:42.051729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-31fad492-3aac-472f-a349-ef2e626e35dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.066793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 624/1218] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:42.072079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984942d-3e4f-40b4-a556-bd2064bf885d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:42.084748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984942d-3e4f-40b4-a556-bd2064bf885d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:42.093819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:42.094465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.099652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.099652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.099652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:42.099652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:42.099652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:42.099652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: warnings.warn(msg) Oct 27 01:23:42.099652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: Oct 27 01:23:42.100239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:42.117940 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 595/1219] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:42.126873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fad492-3aac-472f-a349-ef2e626e35dd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:42.140644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fad492-3aac-472f-a349-ef2e626e35dd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:42.151460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713237c-efcd-4ce9-a236-0fda7d6f0a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:42.152131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713237c-efcd-4ce9-a236-0fda7d6f0a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.152400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713237c-efcd-4ce9-a236-0fda7d6f0a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.152669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713237c-efcd-4ce9-a236-0fda7d6f0a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.153341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713237c-efcd-4ce9-a236-0fda7d6f0a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:42.154403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-a713237c-efcd-4ce9-a236-0fda7d6f0a22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:42.154403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: warnings.warn(msg) Oct 27 01:23:42.154403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: Oct 27 01:23:42.155655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713237c-efcd-4ce9-a236-0fda7d6f0a22 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:42.223315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 625/1220] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:42.227557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:42.241298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec230e0-9742-491e-be8a-8f7516f4d526 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:42.336784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b253142-3c21-4f2c-b574-0b0cc17a222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:42.337425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b253142-3c21-4f2c-b574-0b0cc17a222a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.337712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b253142-3c21-4f2c-b574-0b0cc17a222a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.337989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b253142-3c21-4f2c-b574-0b0cc17a222a admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.338647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b253142-3c21-4f2c-b574-0b0cc17a222a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:42.340131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-8b253142-3c21-4f2c-b574-0b0cc17a222a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:42.340131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: warnings.warn(msg) Oct 27 01:23:42.340131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: Oct 27 01:23:42.341392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b253142-3c21-4f2c-b574-0b0cc17a222a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:42.383119 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 596/1221] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:42.387800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713237c-efcd-4ce9-a236-0fda7d6f0a22 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:42.400563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713237c-efcd-4ce9-a236-0fda7d6f0a22 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:42.415158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a6d5-ad86-4cf1-92ee-255150621ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:42.417160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a6d5-ad86-4cf1-92ee-255150621ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.417160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a6d5-ad86-4cf1-92ee-255150621ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.417160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a6d5-ad86-4cf1-92ee-255150621ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.417704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325a6d5-ad86-4cf1-92ee-255150621ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:42.419417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325a6d5-ad86-4cf1-92ee-255150621ee5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:42.432307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 626/1222] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:42.436694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b253142-3c21-4f2c-b574-0b0cc17a222a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:42.447972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b253142-3c21-4f2c-b574-0b0cc17a222a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:42.462147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfdf56-0777-4301-892f-8f5561fe626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:42.462840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdf56-0777-4301-892f-8f5561fe626d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.463129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdf56-0777-4301-892f-8f5561fe626d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.463405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdf56-0777-4301-892f-8f5561fe626d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.464089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfdf56-0777-4301-892f-8f5561fe626d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:42.466208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfdf56-0777-4301-892f-8f5561fe626d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:42.487264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 597/1223] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:42.492194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a6d5-ad86-4cf1-92ee-255150621ee5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:42.503669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a6d5-ad86-4cf1-92ee-255150621ee5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:42.514220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f95b-52ad-4390-96cf-a5d2a42e758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:42.514960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f95b-52ad-4390-96cf-a5d2a42e758d admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.515245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f95b-52ad-4390-96cf-a5d2a42e758d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.515521 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f95b-52ad-4390-96cf-a5d2a42e758d admin admin] PATH_INFO: `/v3/projects/98f025aa827044ee89ad72a185279955/users/1ca5bd855f014799b077fdb766a272fe/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.544659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4f95b-52ad-4390-96cf-a5d2a42e758d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f025aa827044ee89ad72a185279955, user_id=1ca5bd855f014799b077fdb766a272fe, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:42.547374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4f95b-52ad-4390-96cf-a5d2a42e758d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:42.573093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 627/1224] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:42 2022] PUT /identity/v3/projects/98f025aa827044ee89ad72a185279955/users/1ca5bd855f014799b077fdb766a272fe/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:42.590708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d212b-1f2d-4b32-bc95-130c7e8abfb4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.591078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d212b-1f2d-4b32-bc95-130c7e8abfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.591289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d212b-1f2d-4b32-bc95-130c7e8abfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.631399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b56ac-011b-4bcc-bb40-3878083f1de4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.631765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b56ac-011b-4bcc-bb40-3878083f1de4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.631960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b56ac-011b-4bcc-bb40-3878083f1de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.649636 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1b4d212b-1f2d-4b32-bc95-130c7e8abfb4 None None] MFA Rules not processed for user `1ca5bd855f014799b077fdb766a272fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:42.650936 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1b4d212b-1f2d-4b32-bc95-130c7e8abfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.680546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2a1b56ac-011b-4bcc-bb40-3878083f1de4 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:42.681783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2a1b56ac-011b-4bcc-bb40-3878083f1de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.793463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 598/1225] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:42.795858 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486248f-2f2e-4c8d-bbb5-a32278c99694 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.796137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486248f-2f2e-4c8d-bbb5-a32278c99694 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.796421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486248f-2f2e-4c8d-bbb5-a32278c99694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.804687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 628/1226] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:42.806301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede8fff-8c01-4f96-a80d-6d7df0061ef9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.808394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede8fff-8c01-4f96-a80d-6d7df0061ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.809018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede8fff-8c01-4f96-a80d-6d7df0061ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.844593 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e486248f-2f2e-4c8d-bbb5-a32278c99694 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:42.845770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e486248f-2f2e-4c8d-bbb5-a32278c99694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.854759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fede8fff-8c01-4f96-a80d-6d7df0061ef9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:42.856064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fede8fff-8c01-4f96-a80d-6d7df0061ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.861574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 599/1227] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:42.862708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a5375-9418-40bb-8d59-7463e9f5396c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.863321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a5375-9418-40bb-8d59-7463e9f5396c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.863321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a5375-9418-40bb-8d59-7463e9f5396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.879991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 629/1228] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:42.880839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede8fff-8c01-4f96-a80d-6d7df0061ef9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:42.892282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede8fff-8c01-4f96-a80d-6d7df0061ef9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:42.894506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-704a5375-9418-40bb-8d59-7463e9f5396c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:42.895764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-704a5375-9418-40bb-8d59-7463e9f5396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.897225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a46a0-a552-4f0b-a75a-1f034e10dba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:42.897843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a46a0-a552-4f0b-a75a-1f034e10dba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.898123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a46a0-a552-4f0b-a75a-1f034e10dba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.898396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a46a0-a552-4f0b-a75a-1f034e10dba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.899070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a46a0-a552-4f0b-a75a-1f034e10dba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:42.900967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a46a0-a552-4f0b-a75a-1f034e10dba8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:42.903695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 600/1229] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:42.904893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e49e-18f5-46a8-93be-5ac0bae6fed1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.905183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e49e-18f5-46a8-93be-5ac0bae6fed1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.905462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e49e-18f5-46a8-93be-5ac0bae6fed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.925248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7588e49e-18f5-46a8-93be-5ac0bae6fed1 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:42.926502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7588e49e-18f5-46a8-93be-5ac0bae6fed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.930938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 630/1230] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:42.932362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d3fbb-85ec-4b98-a9d3-43280b649391 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.932607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d3fbb-85ec-4b98-a9d3-43280b649391 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.932871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d3fbb-85ec-4b98-a9d3-43280b649391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.935242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 601/1231] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:42.936339 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb564-688f-4583-abb5-eb31732a0416 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:42.936633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb564-688f-4583-abb5-eb31732a0416 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:42.936909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb564-688f-4583-abb5-eb31732a0416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:42.952788 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f36d3fbb-85ec-4b98-a9d3-43280b649391 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:42.953999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f36d3fbb-85ec-4b98-a9d3-43280b649391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.956081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-405eb564-688f-4583-abb5-eb31732a0416 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:42.957355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-405eb564-688f-4583-abb5-eb31732a0416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:42.982499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:43.004122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:43.013923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 631/1232] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:43.015185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4f038-1236-4dc8-a363-45e62615462c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.015471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4f038-1236-4dc8-a363-45e62615462c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.015750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4f038-1236-4dc8-a363-45e62615462c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.019502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 602/1233] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:43.020626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9559f5-e39a-49a6-b675-32b02faad167 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.020914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9559f5-e39a-49a6-b675-32b02faad167 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.021188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9559f5-e39a-49a6-b675-32b02faad167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.037198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4ba4f038-1236-4dc8-a363-45e62615462c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:43.038410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4ba4f038-1236-4dc8-a363-45e62615462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:43.041257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ae9559f5-e39a-49a6-b675-32b02faad167 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:43.042431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ae9559f5-e39a-49a6-b675-32b02faad167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:43.047067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 632/1234] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:43.048179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf36e-97a2-426e-96a4-e68aef1cd367 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.048454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf36e-97a2-426e-96a4-e68aef1cd367 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.048725 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf36e-97a2-426e-96a4-e68aef1cd367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.052225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 603/1235] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:43.053413 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9282b-61f3-4bce-9a47-bafd4b015ea1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.053699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9282b-61f3-4bce-9a47-bafd4b015ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.053970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9282b-61f3-4bce-9a47-bafd4b015ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.068997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-83daf36e-97a2-426e-96a4-e68aef1cd367 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:43.070226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-83daf36e-97a2-426e-96a4-e68aef1cd367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:43.073070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-99f9282b-61f3-4bce-9a47-bafd4b015ea1 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:43.074226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-99f9282b-61f3-4bce-9a47-bafd4b015ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:43.078282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 633/1236] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:43.079052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf36e-97a2-426e-96a4-e68aef1cd367 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.082555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 604/1237] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:43.083293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9282b-61f3-4bce-9a47-bafd4b015ea1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.091165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf36e-97a2-426e-96a4-e68aef1cd367 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.092635 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9282b-61f3-4bce-9a47-bafd4b015ea1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.095892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ffac3-2364-46c5-aa93-2ecdb41f29e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.096507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ffac3-2364-46c5-aa93-2ecdb41f29e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.096819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ffac3-2364-46c5-aa93-2ecdb41f29e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.097093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ffac3-2364-46c5-aa93-2ecdb41f29e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.097477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed79a2b-0d58-4011-8310-1010460ce3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.097725 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ffac3-2364-46c5-aa93-2ecdb41f29e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.098071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79a2b-0d58-4011-8310-1010460ce3aa admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.098352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79a2b-0d58-4011-8310-1010460ce3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.098621 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79a2b-0d58-4011-8310-1010460ce3aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.099304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79a2b-0d58-4011-8310-1010460ce3aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:43.099605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79a2b-0d58-4011-8310-1010460ce3aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.099699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ffac3-2364-46c5-aa93-2ecdb41f29e6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.101252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79a2b-0d58-4011-8310-1010460ce3aa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.113922 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 605/1238] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:43.115373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d85fe-d244-4db1-a2b7-084ef6f1a74a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.115702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d85fe-d244-4db1-a2b7-084ef6f1a74a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.115979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d85fe-d244-4db1-a2b7-084ef6f1a74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.128583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 634/1239] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/users => generated 308 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.129899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478352f-748d-4ed5-8631-5d72729ebb40 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.130189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478352f-748d-4ed5-8631-5d72729ebb40 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.130468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478352f-748d-4ed5-8631-5d72729ebb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.137503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f24d85fe-d244-4db1-a2b7-084ef6f1a74a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:43.138784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f24d85fe-d244-4db1-a2b7-084ef6f1a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:43.147439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 606/1240] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:43.148253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d85fe-d244-4db1-a2b7-084ef6f1a74a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.150453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2478352f-748d-4ed5-8631-5d72729ebb40 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:43.151746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2478352f-748d-4ed5-8631-5d72729ebb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:43.157783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d85fe-d244-4db1-a2b7-084ef6f1a74a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.161105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 635/1241] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:43.162297 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe359178-3a9d-4761-8261-a3bfd9f631e5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.162528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a670-9f4b-4c2b-b461-92e909b342a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.162659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe359178-3a9d-4761-8261-a3bfd9f631e5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.162875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe359178-3a9d-4761-8261-a3bfd9f631e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.163149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a670-9f4b-4c2b-b461-92e909b342a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.163429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a670-9f4b-4c2b-b461-92e909b342a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.163702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a670-9f4b-4c2b-b461-92e909b342a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.164361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303a670-9f4b-4c2b-b461-92e909b342a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:43.164642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303a670-9f4b-4c2b-b461-92e909b342a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.166221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303a670-9f4b-4c2b-b461-92e909b342a0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.177916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 607/1242] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:43.178535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a670-9f4b-4c2b-b461-92e909b342a0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.182471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fe359178-3a9d-4761-8261-a3bfd9f631e5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:43.183694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fe359178-3a9d-4761-8261-a3bfd9f631e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:43.188018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a670-9f4b-4c2b-b461-92e909b342a0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.192661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307060b-e6a4-437e-b9b2-83f8e27d0fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.192792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 636/1243] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:43.193247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307060b-e6a4-437e-b9b2-83f8e27d0fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.193536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307060b-e6a4-437e-b9b2-83f8e27d0fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.193645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe359178-3a9d-4761-8261-a3bfd9f631e5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.193806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307060b-e6a4-437e-b9b2-83f8e27d0fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.194436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307060b-e6a4-437e-b9b2-83f8e27d0fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:43.194757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307060b-e6a4-437e-b9b2-83f8e27d0fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.196523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307060b-e6a4-437e-b9b2-83f8e27d0fc8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.203490 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe359178-3a9d-4761-8261-a3bfd9f631e5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.208195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baf79b-2f7b-4f34-97d1-7a914e4e2751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.208780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baf79b-2f7b-4f34-97d1-7a914e4e2751 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.209057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baf79b-2f7b-4f34-97d1-7a914e4e2751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.209295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baf79b-2f7b-4f34-97d1-7a914e4e2751 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.209739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 608/1244] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:43.209973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baf79b-2f7b-4f34-97d1-7a914e4e2751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:43.210267 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baf79b-2f7b-4f34-97d1-7a914e4e2751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.210516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307060b-e6a4-437e-b9b2-83f8e27d0fc8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.211997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baf79b-2f7b-4f34-97d1-7a914e4e2751 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.220186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307060b-e6a4-437e-b9b2-83f8e27d0fc8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.223953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 637/1245] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:43.224749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baf79b-2f7b-4f34-97d1-7a914e4e2751 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.224880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beae7c-3fe3-4893-8b5e-a83a4e9cf3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.225471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beae7c-3fe3-4893-8b5e-a83a4e9cf3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.225747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beae7c-3fe3-4893-8b5e-a83a4e9cf3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.226022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beae7c-3fe3-4893-8b5e-a83a4e9cf3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.226646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beae7c-3fe3-4893-8b5e-a83a4e9cf3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.228552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beae7c-3fe3-4893-8b5e-a83a4e9cf3d4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.235974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baf79b-2f7b-4f34-97d1-7a914e4e2751 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.241726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8b38e-1f09-4576-ac6d-a80e7365baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.242359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8b38e-1f09-4576-ac6d-a80e7365baa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.242639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8b38e-1f09-4576-ac6d-a80e7365baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.242952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8b38e-1f09-4576-ac6d-a80e7365baa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.243629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8b38e-1f09-4576-ac6d-a80e7365baa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.245306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8b38e-1f09-4576-ac6d-a80e7365baa4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.259718 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 609/1246] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.259910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 638/1247] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:43.260020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beae7c-3fe3-4893-8b5e-a83a4e9cf3d4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.260133 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8b38e-1f09-4576-ac6d-a80e7365baa4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.267648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8b38e-1f09-4576-ac6d-a80e7365baa4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.320240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beae7c-3fe3-4893-8b5e-a83a4e9cf3d4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.324657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e17df-c2c1-4dc4-a037-7076d70c39c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.325133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808afa5-22b6-4474-9892-df732483d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.325272 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e17df-c2c1-4dc4-a037-7076d70c39c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.325542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e17df-c2c1-4dc4-a037-7076d70c39c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.325826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e17df-c2c1-4dc4-a037-7076d70c39c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.325940 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808afa5-22b6-4474-9892-df732483d66e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.326142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808afa5-22b6-4474-9892-df732483d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.326471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e17df-c2c1-4dc4-a037-7076d70c39c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:43.326585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808afa5-22b6-4474-9892-df732483d66e admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.326800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e17df-c2c1-4dc4-a037-7076d70c39c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.327155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808afa5-22b6-4474-9892-df732483d66e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:43.327483 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808afa5-22b6-4474-9892-df732483d66e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.328431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e17df-c2c1-4dc4-a037-7076d70c39c2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.329065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808afa5-22b6-4474-9892-df732483d66e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.339820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 639/1248] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:43.340602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e17df-c2c1-4dc4-a037-7076d70c39c2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.341056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 610/1249] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:43.341977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808afa5-22b6-4474-9892-df732483d66e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.350175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e17df-c2c1-4dc4-a037-7076d70c39c2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.352117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808afa5-22b6-4474-9892-df732483d66e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.354965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428e8f-0f0a-4f1b-afc8-a227eb8f7427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.355569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428e8f-0f0a-4f1b-afc8-a227eb8f7427 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.355844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428e8f-0f0a-4f1b-afc8-a227eb8f7427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.356172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428e8f-0f0a-4f1b-afc8-a227eb8f7427 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.356739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e428e8f-0f0a-4f1b-afc8-a227eb8f7427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.357407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6379809-0e44-4668-be50-78fc43e3db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.358012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6379809-0e44-4668-be50-78fc43e3db36 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.358293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6379809-0e44-4668-be50-78fc43e3db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.358567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6379809-0e44-4668-be50-78fc43e3db36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.358665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e428e8f-0f0a-4f1b-afc8-a227eb8f7427 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.359301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6379809-0e44-4668-be50-78fc43e3db36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:43.359605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6379809-0e44-4668-be50-78fc43e3db36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.361204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6379809-0e44-4668-be50-78fc43e3db36 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.374131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 611/1250] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:43.375536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6379809-0e44-4668-be50-78fc43e3db36 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.385565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6379809-0e44-4668-be50-78fc43e3db36 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.390422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed99f92-80fa-46a6-90f1-d7653e0243c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.391059 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed99f92-80fa-46a6-90f1-d7653e0243c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.391422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed99f92-80fa-46a6-90f1-d7653e0243c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.391700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed99f92-80fa-46a6-90f1-d7653e0243c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.392353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed99f92-80fa-46a6-90f1-d7653e0243c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.394368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 640/1251] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.394502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed99f92-80fa-46a6-90f1-d7653e0243c8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.395317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428e8f-0f0a-4f1b-afc8-a227eb8f7427 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.424284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 612/1252] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.425385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed99f92-80fa-46a6-90f1-d7653e0243c8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.434425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:43.458070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428e8f-0f0a-4f1b-afc8-a227eb8f7427 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.466016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:43.490600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed99f92-80fa-46a6-90f1-d7653e0243c8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.495319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3c2b6-e208-4cf0-b2de-5802dd5e2395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.495938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3c2b6-e208-4cf0-b2de-5802dd5e2395 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.496222 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3c2b6-e208-4cf0-b2de-5802dd5e2395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.496497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3c2b6-e208-4cf0-b2de-5802dd5e2395 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.497143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3c2b6-e208-4cf0-b2de-5802dd5e2395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.499116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3c2b6-e208-4cf0-b2de-5802dd5e2395 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.516581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847d3b2-2fac-4c59-905e-6016401585ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.517208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847d3b2-2fac-4c59-905e-6016401585ed admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.517547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847d3b2-2fac-4c59-905e-6016401585ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.517818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847d3b2-2fac-4c59-905e-6016401585ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.518467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847d3b2-2fac-4c59-905e-6016401585ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.520386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847d3b2-2fac-4c59-905e-6016401585ed admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.522010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 613/1253] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.522844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3c2b6-e208-4cf0-b2de-5802dd5e2395 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.532354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3c2b6-e208-4cf0-b2de-5802dd5e2395 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.536963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b53df-5c74-4af2-bfdc-aa4730369cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.537618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b53df-5c74-4af2-bfdc-aa4730369cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.537900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b53df-5c74-4af2-bfdc-aa4730369cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.538177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b53df-5c74-4af2-bfdc-aa4730369cee admin admin] PATH_INFO: `/v3/projects/b0b42de3a3a54b86affd3c92e760a7be/users/d17afade8e824430b1bc9b28bd114a8c/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.552933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 641/1254] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/projects => generated 403 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.552933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847d3b2-2fac-4c59-905e-6016401585ed admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.554273 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b53df-5c74-4af2-bfdc-aa4730369cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b42de3a3a54b86affd3c92e760a7be, user_id=d17afade8e824430b1bc9b28bd114a8c, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.557408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b53df-5c74-4af2-bfdc-aa4730369cee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.572606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 614/1255] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:43 2022] PUT /identity/v3/projects/b0b42de3a3a54b86affd3c92e760a7be/users/d17afade8e824430b1bc9b28bd114a8c/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:43.573794 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b53df-5c74-4af2-bfdc-aa4730369cee admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.615547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847d3b2-2fac-4c59-905e-6016401585ed admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.635237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b53df-5c74-4af2-bfdc-aa4730369cee admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.640042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acbb41-80f9-494a-9b18-16d5b376da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.640657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acbb41-80f9-494a-9b18-16d5b376da89 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.640938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acbb41-80f9-494a-9b18-16d5b376da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.641211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acbb41-80f9-494a-9b18-16d5b376da89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.641846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acbb41-80f9-494a-9b18-16d5b376da89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.643858 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acbb41-80f9-494a-9b18-16d5b376da89 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.671659 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 615/1256] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.672528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d43ff-ee89-40da-8e2e-e2ec636cb88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.672694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acbb41-80f9-494a-9b18-16d5b376da89 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.673146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d43ff-ee89-40da-8e2e-e2ec636cb88c admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.673427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d43ff-ee89-40da-8e2e-e2ec636cb88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.673693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d43ff-ee89-40da-8e2e-e2ec636cb88c admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.674326 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d43ff-ee89-40da-8e2e-e2ec636cb88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.676335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d43ff-ee89-40da-8e2e-e2ec636cb88c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.703969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 642/1257] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.704905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d43ff-ee89-40da-8e2e-e2ec636cb88c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.736441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:43.737040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:43.740957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acbb41-80f9-494a-9b18-16d5b376da89 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.772148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d43ff-ee89-40da-8e2e-e2ec636cb88c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.777251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02e1cc-e261-472a-a5bf-6808fb731317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.777881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02e1cc-e261-472a-a5bf-6808fb731317 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.778162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02e1cc-e261-472a-a5bf-6808fb731317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.778439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02e1cc-e261-472a-a5bf-6808fb731317 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.779099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02e1cc-e261-472a-a5bf-6808fb731317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.781955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02e1cc-e261-472a-a5bf-6808fb731317 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.803252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee62b36-78e3-409b-ae92-a004c6289448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.803880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee62b36-78e3-409b-ae92-a004c6289448 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.804170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee62b36-78e3-409b-ae92-a004c6289448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.804441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee62b36-78e3-409b-ae92-a004c6289448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.805089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee62b36-78e3-409b-ae92-a004c6289448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.806176 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 643/1258] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.807203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee62b36-78e3-409b-ae92-a004c6289448 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.807803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02e1cc-e261-472a-a5bf-6808fb731317 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.817545 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02e1cc-e261-472a-a5bf-6808fb731317 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.822990 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec41e4-354b-49f3-b61c-cfc1b0b8cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.823517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec41e4-354b-49f3-b61c-cfc1b0b8cbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.823795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec41e4-354b-49f3-b61c-cfc1b0b8cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.824066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec41e4-354b-49f3-b61c-cfc1b0b8cbe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.824818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec41e4-354b-49f3-b61c-cfc1b0b8cbe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.826969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec41e4-354b-49f3-b61c-cfc1b0b8cbe2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.834415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 616/1259] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.835371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee62b36-78e3-409b-ae92-a004c6289448 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.858596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 644/1260] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.858596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec41e4-354b-49f3-b61c-cfc1b0b8cbe2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.866486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec41e4-354b-49f3-b61c-cfc1b0b8cbe2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.904487 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee62b36-78e3-409b-ae92-a004c6289448 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.910044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d6339-af7b-4746-9740-0bc17eb74bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.910668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d6339-af7b-4746-9740-0bc17eb74bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.910982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d6339-af7b-4746-9740-0bc17eb74bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.911262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d6339-af7b-4746-9740-0bc17eb74bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.911925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d6339-af7b-4746-9740-0bc17eb74bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.913580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d6339-af7b-4746-9740-0bc17eb74bfa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.923354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 617/1261] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:43.924217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d6339-af7b-4746-9740-0bc17eb74bfa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.924348 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeff1e1-8cc2-4a54-9a19-3f8f387a08ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.924973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeff1e1-8cc2-4a54-9a19-3f8f387a08ec admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.925247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeff1e1-8cc2-4a54-9a19-3f8f387a08ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.925520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeff1e1-8cc2-4a54-9a19-3f8f387a08ec admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.926205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeff1e1-8cc2-4a54-9a19-3f8f387a08ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.928562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeff1e1-8cc2-4a54-9a19-3f8f387a08ec admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.936346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d6339-af7b-4746-9740-0bc17eb74bfa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.943342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf06b11-f797-4c8d-b75e-62c314791705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.944073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf06b11-f797-4c8d-b75e-62c314791705 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.944384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf06b11-f797-4c8d-b75e-62c314791705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.944679 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf06b11-f797-4c8d-b75e-62c314791705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.945430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf06b11-f797-4c8d-b75e-62c314791705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.947211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf06b11-f797-4c8d-b75e-62c314791705 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.951898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 645/1262] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.952805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeff1e1-8cc2-4a54-9a19-3f8f387a08ec admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.963920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 618/1263] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:43.963920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf06b11-f797-4c8d-b75e-62c314791705 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:43.964198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeff1e1-8cc2-4a54-9a19-3f8f387a08ec admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.968707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84f8e9-4bcd-4325-883c-34b0f2188984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.969305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84f8e9-4bcd-4325-883c-34b0f2188984 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.969584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84f8e9-4bcd-4325-883c-34b0f2188984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.969858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84f8e9-4bcd-4325-883c-34b0f2188984 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.970491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84f8e9-4bcd-4325-883c-34b0f2188984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.971332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf06b11-f797-4c8d-b75e-62c314791705 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:43.972542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84f8e9-4bcd-4325-883c-34b0f2188984 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.976204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9215f-38b7-442c-af41-d24f373fdfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:43.976821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9215f-38b7-442c-af41-d24f373fdfdc admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:43.977129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9215f-38b7-442c-af41-d24f373fdfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:43.977376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9215f-38b7-442c-af41-d24f373fdfdc admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:43.978041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9215f-38b7-442c-af41-d24f373fdfdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:43.979985 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9215f-38b7-442c-af41-d24f373fdfdc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:43.997022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 646/1264] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:43.998316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84f8e9-4bcd-4325-883c-34b0f2188984 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.003864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 619/1265] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:43 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:44.004617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9215f-38b7-442c-af41-d24f373fdfdc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.009845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84f8e9-4bcd-4325-883c-34b0f2188984 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.014282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9215f-38b7-442c-af41-d24f373fdfdc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.014420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3956ff1-1922-44e4-bafc-1d1ed9be38af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.015055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956ff1-1922-44e4-bafc-1d1ed9be38af admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.015337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956ff1-1922-44e4-bafc-1d1ed9be38af admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.015603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956ff1-1922-44e4-bafc-1d1ed9be38af admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.016245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3956ff1-1922-44e4-bafc-1d1ed9be38af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.017824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3956ff1-1922-44e4-bafc-1d1ed9be38af admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.018990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bd68e-11e6-49f4-bd8f-1d1e9a4e1eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.019590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bd68e-11e6-49f4-bd8f-1d1e9a4e1eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.019871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bd68e-11e6-49f4-bd8f-1d1e9a4e1eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.020164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bd68e-11e6-49f4-bd8f-1d1e9a4e1eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.020770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bd68e-11e6-49f4-bd8f-1d1e9a4e1eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.022644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bd68e-11e6-49f4-bd8f-1d1e9a4e1eb4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.028072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 647/1266] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.028863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3956ff1-1922-44e4-bafc-1d1ed9be38af admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.038504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3956ff1-1922-44e4-bafc-1d1ed9be38af admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.043618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2891-a6b2-4ed3-bd01-7e40466d56af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.044214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2891-a6b2-4ed3-bd01-7e40466d56af admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.044490 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2891-a6b2-4ed3-bd01-7e40466d56af admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.044762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2891-a6b2-4ed3-bd01-7e40466d56af admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.045403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a2891-a6b2-4ed3-bd01-7e40466d56af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.047012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a2891-a6b2-4ed3-bd01-7e40466d56af admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.051272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 620/1267] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:44 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:44.051272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bd68e-11e6-49f4-bd8f-1d1e9a4e1eb4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.058548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bd68e-11e6-49f4-bd8f-1d1e9a4e1eb4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.060337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 648/1268] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.061169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2891-a6b2-4ed3-bd01-7e40466d56af admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.064086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45b4bb-960f-4d1e-a977-f4561dff8906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.064682 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b4bb-960f-4d1e-a977-f4561dff8906 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.064960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b4bb-960f-4d1e-a977-f4561dff8906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.065229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b4bb-960f-4d1e-a977-f4561dff8906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.066118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45b4bb-960f-4d1e-a977-f4561dff8906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.068297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45b4bb-960f-4d1e-a977-f4561dff8906 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.070625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2891-a6b2-4ed3-bd01-7e40466d56af admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.076016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9783249-9a7f-425f-b3df-ba4fdf129c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.076771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9783249-9a7f-425f-b3df-ba4fdf129c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.077198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9783249-9a7f-425f-b3df-ba4fdf129c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.077471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9783249-9a7f-425f-b3df-ba4fdf129c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.078098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9783249-9a7f-425f-b3df-ba4fdf129c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.079149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 621/1269] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.079974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9783249-9a7f-425f-b3df-ba4fdf129c12 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.083289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45b4bb-960f-4d1e-a977-f4561dff8906 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.093182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 649/1270] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.093182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9783249-9a7f-425f-b3df-ba4fdf129c12 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.093456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45b4bb-960f-4d1e-a977-f4561dff8906 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.098471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64d5a2-d04d-4929-b697-f8a6ec48e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.099168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64d5a2-d04d-4929-b697-f8a6ec48e240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.099479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64d5a2-d04d-4929-b697-f8a6ec48e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.099713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64d5a2-d04d-4929-b697-f8a6ec48e240 admin admin] PATH_INFO: `/v3/projects/b0b42de3a3a54b86affd3c92e760a7be/users/d17afade8e824430b1bc9b28bd114a8c/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.101795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64d5a2-d04d-4929-b697-f8a6ec48e240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b42de3a3a54b86affd3c92e760a7be, user_id=d17afade8e824430b1bc9b28bd114a8c, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.102475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9783249-9a7f-425f-b3df-ba4fdf129c12 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.104441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64d5a2-d04d-4929-b697-f8a6ec48e240 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.107240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87399d-24a1-4c8b-9f99-4cefc20e4637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.107816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87399d-24a1-4c8b-9f99-4cefc20e4637 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.108098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87399d-24a1-4c8b-9f99-4cefc20e4637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.108373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87399d-24a1-4c8b-9f99-4cefc20e4637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.109010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87399d-24a1-4c8b-9f99-4cefc20e4637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.110874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87399d-24a1-4c8b-9f99-4cefc20e4637 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.114972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 622/1271] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:44 2022] PUT /identity/v3/projects/b0b42de3a3a54b86affd3c92e760a7be/users/d17afade8e824430b1bc9b28bd114a8c/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:44.115808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64d5a2-d04d-4929-b697-f8a6ec48e240 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.121300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 650/1272] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.122241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87399d-24a1-4c8b-9f99-4cefc20e4637 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.136234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87399d-24a1-4c8b-9f99-4cefc20e4637 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.143684 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:44.161657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:44.191589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64d5a2-d04d-4929-b697-f8a6ec48e240 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.192478 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee816f-e422-4a38-a600-af17682bece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.193090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee816f-e422-4a38-a600-af17682bece0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.193367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee816f-e422-4a38-a600-af17682bece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.193637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee816f-e422-4a38-a600-af17682bece0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.194277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee816f-e422-4a38-a600-af17682bece0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.195890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee816f-e422-4a38-a600-af17682bece0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.196221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae634e9-2ce4-47ef-b472-4016776e2764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.196832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae634e9-2ce4-47ef-b472-4016776e2764 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.197117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae634e9-2ce4-47ef-b472-4016776e2764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.197380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae634e9-2ce4-47ef-b472-4016776e2764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.198055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae634e9-2ce4-47ef-b472-4016776e2764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.199667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae634e9-2ce4-47ef-b472-4016776e2764 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.206071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 651/1273] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.206681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee816f-e422-4a38-a600-af17682bece0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.216147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee816f-e422-4a38-a600-af17682bece0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.219631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 623/1274] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.219631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae634e9-2ce4-47ef-b472-4016776e2764 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.223841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250de4-4e2c-4db6-8e98-522eb50db0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.224486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250de4-4e2c-4db6-8e98-522eb50db0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.224761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250de4-4e2c-4db6-8e98-522eb50db0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.225041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250de4-4e2c-4db6-8e98-522eb50db0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.225676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37250de4-4e2c-4db6-8e98-522eb50db0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.227264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37250de4-4e2c-4db6-8e98-522eb50db0d0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.227415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae634e9-2ce4-47ef-b472-4016776e2764 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.232321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc3cb-b33c-4105-b292-238019c36b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.232906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc3cb-b33c-4105-b292-238019c36b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.233185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc3cb-b33c-4105-b292-238019c36b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.233455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fc3cb-b33c-4105-b292-238019c36b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.234096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fc3cb-b33c-4105-b292-238019c36b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.235720 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fc3cb-b33c-4105-b292-238019c36b77 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.238063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 652/1275] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.238854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250de4-4e2c-4db6-8e98-522eb50db0d0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.246246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 624/1276] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.246962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc3cb-b33c-4105-b292-238019c36b77 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.251775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250de4-4e2c-4db6-8e98-522eb50db0d0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.256652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fc3cb-b33c-4105-b292-238019c36b77 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.256827 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53095815-1123-4503-87ad-7e7376589cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.257405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53095815-1123-4503-87ad-7e7376589cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.257681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53095815-1123-4503-87ad-7e7376589cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.257950 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53095815-1123-4503-87ad-7e7376589cc0 admin admin] PATH_INFO: `/v3/projects/4e45034653c340bba4dcb450b83175b7/users/563728f1570c48c3b79bf36e32681a14/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.261082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f445b-09fa-457b-87e0-06597da2364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.261651 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f445b-09fa-457b-87e0-06597da2364f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.261928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f445b-09fa-457b-87e0-06597da2364f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.262199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f445b-09fa-457b-87e0-06597da2364f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.262847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f445b-09fa-457b-87e0-06597da2364f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.264395 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f445b-09fa-457b-87e0-06597da2364f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.272516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53095815-1123-4503-87ad-7e7376589cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e45034653c340bba4dcb450b83175b7, user_id=563728f1570c48c3b79bf36e32681a14, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.274099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 625/1277] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.274914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f445b-09fa-457b-87e0-06597da2364f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.275273 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53095815-1123-4503-87ad-7e7376589cc0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.284655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f445b-09fa-457b-87e0-06597da2364f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.289115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 653/1278] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:44 2022] PUT /identity/v3/projects/4e45034653c340bba4dcb450b83175b7/users/563728f1570c48c3b79bf36e32681a14/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:44.290396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3741f4-ba5e-4a5a-824f-4b98af188cf3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.290682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3741f4-ba5e-4a5a-824f-4b98af188cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.290981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3741f4-ba5e-4a5a-824f-4b98af188cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.318899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ec3741f4-ba5e-4a5a-824f-4b98af188cf3 None None] MFA Rules not processed for user `d17afade8e824430b1bc9b28bd114a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:44.320357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ec3741f4-ba5e-4a5a-824f-4b98af188cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:44.341397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5d5cb-1021-4a69-ac0e-51085eac0c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.341954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d5cb-1021-4a69-ac0e-51085eac0c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.342219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d5cb-1021-4a69-ac0e-51085eac0c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.342493 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d5cb-1021-4a69-ac0e-51085eac0c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.343193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5d5cb-1021-4a69-ac0e-51085eac0c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.344796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5d5cb-1021-4a69-ac0e-51085eac0c3c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.355181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 626/1279] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.356055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5d5cb-1021-4a69-ac0e-51085eac0c3c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.365822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5d5cb-1021-4a69-ac0e-51085eac0c3c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.371245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d7cfc-b796-4aa8-bd6b-bde686cbd4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.371913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7cfc-b796-4aa8-bd6b-bde686cbd4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.372191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7cfc-b796-4aa8-bd6b-bde686cbd4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.372461 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7cfc-b796-4aa8-bd6b-bde686cbd4e9 admin admin] PATH_INFO: `/v3/projects/613c726cd46241c694df5152f52ff8cd/users/a786f92c9ac34323b919703c322c7df8/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.387840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d7cfc-b796-4aa8-bd6b-bde686cbd4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613c726cd46241c694df5152f52ff8cd, user_id=a786f92c9ac34323b919703c322c7df8, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.389298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 654/1280] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:44.390140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3741f4-ba5e-4a5a-824f-4b98af188cf3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.391955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d7cfc-b796-4aa8-bd6b-bde686cbd4e9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.400460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3741f4-ba5e-4a5a-824f-4b98af188cf3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.408341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 627/1281] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:44 2022] PUT /identity/v3/projects/613c726cd46241c694df5152f52ff8cd/users/a786f92c9ac34323b919703c322c7df8/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:44.409331 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d7cfc-b796-4aa8-bd6b-bde686cbd4e9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.457282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c97c9-bc90-4b67-944e-2f62c045c8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.457905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c97c9-bc90-4b67-944e-2f62c045c8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.458185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c97c9-bc90-4b67-944e-2f62c045c8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.458463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c97c9-bc90-4b67-944e-2f62c045c8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.459172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c97c9-bc90-4b67-944e-2f62c045c8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.460931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c97c9-bc90-4b67-944e-2f62c045c8a2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.470959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 655/1282] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.472093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c97c9-bc90-4b67-944e-2f62c045c8a2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.479202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d7cfc-b796-4aa8-bd6b-bde686cbd4e9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.481499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c97c9-bc90-4b67-944e-2f62c045c8a2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.483804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22119e1a-dee3-4509-b857-e172e2327c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.484423 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119e1a-dee3-4509-b857-e172e2327c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.484724 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119e1a-dee3-4509-b857-e172e2327c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.484968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119e1a-dee3-4509-b857-e172e2327c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.485615 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22119e1a-dee3-4509-b857-e172e2327c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.486049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ebe50-0783-4bbf-a0ab-c757f40b60e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.486681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebe50-0783-4bbf-a0ab-c757f40b60e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.486998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebe50-0783-4bbf-a0ab-c757f40b60e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.487298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22119e1a-dee3-4509-b857-e172e2327c84 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.487410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebe50-0783-4bbf-a0ab-c757f40b60e9 admin admin] PATH_INFO: `/v3/projects/a41e52f4681f4049b157afa5dac82b21/users/c37589330ceb4193a7a504600b4ced84/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.489759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:44.495682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:44.499405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 628/1283] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:44.500636 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22119e1a-dee3-4509-b857-e172e2327c84 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.507258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ebe50-0783-4bbf-a0ab-c757f40b60e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41e52f4681f4049b157afa5dac82b21, user_id=c37589330ceb4193a7a504600b4ced84, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.509890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ebe50-0783-4bbf-a0ab-c757f40b60e9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.510292 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22119e1a-dee3-4509-b857-e172e2327c84 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.515195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266153a-57cb-44b9-8075-12f158eae082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.515911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266153a-57cb-44b9-8075-12f158eae082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.516236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266153a-57cb-44b9-8075-12f158eae082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.516512 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266153a-57cb-44b9-8075-12f158eae082 admin admin] PATH_INFO: `/v3/projects/1fe364be20f74cc7892bd9b91f856312/users/b61f3548f1254a289eba50b86071aae3/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.523365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 656/1284] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:44 2022] PUT /identity/v3/projects/a41e52f4681f4049b157afa5dac82b21/users/c37589330ceb4193a7a504600b4ced84/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:44.527201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2ab1d-199f-4247-bdae-dbd9af354bf9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.527201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2ab1d-199f-4247-bdae-dbd9af354bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.527201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2ab1d-199f-4247-bdae-dbd9af354bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.534283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266153a-57cb-44b9-8075-12f158eae082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe364be20f74cc7892bd9b91f856312, user_id=b61f3548f1254a289eba50b86071aae3, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.536997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266153a-57cb-44b9-8075-12f158eae082 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.543418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e0d2ab1d-199f-4247-bdae-dbd9af354bf9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:44.544619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e0d2ab1d-199f-4247-bdae-dbd9af354bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:44.550497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 629/1285] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:44 2022] PUT /identity/v3/projects/1fe364be20f74cc7892bd9b91f856312/users/b61f3548f1254a289eba50b86071aae3/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:44.551454 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266153a-57cb-44b9-8075-12f158eae082 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.604088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 657/1286] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:44.604855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2ab1d-199f-4247-bdae-dbd9af354bf9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.616154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266153a-57cb-44b9-8075-12f158eae082 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.621429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa26770-9134-4684-bfc9-32bcf77bb790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.622106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa26770-9134-4684-bfc9-32bcf77bb790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.622382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa26770-9134-4684-bfc9-32bcf77bb790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.622649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa26770-9134-4684-bfc9-32bcf77bb790 admin admin] PATH_INFO: `/v3/projects/533cbce802584456b0e55a80c7cc291d/users/16050dda2b5e42e2b245dfc5f4a43532/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.638350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa26770-9134-4684-bfc9-32bcf77bb790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533cbce802584456b0e55a80c7cc291d, user_id=16050dda2b5e42e2b245dfc5f4a43532, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.640997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa26770-9134-4684-bfc9-32bcf77bb790 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.654890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 630/1287] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:44 2022] PUT /identity/v3/projects/533cbce802584456b0e55a80c7cc291d/users/16050dda2b5e42e2b245dfc5f4a43532/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:44.656547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabcc35-df46-4d62-a5df-3356179eabc0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.656840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabcc35-df46-4d62-a5df-3356179eabc0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.657113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabcc35-df46-4d62-a5df-3356179eabc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.663374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2ab1d-199f-4247-bdae-dbd9af354bf9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.684587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fbabcc35-df46-4d62-a5df-3356179eabc0 None None] MFA Rules not processed for user `a786f92c9ac34323b919703c322c7df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:44.685789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fbabcc35-df46-4d62-a5df-3356179eabc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:44.711578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e352a-d239-451e-a3de-7c1d50767731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.712226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e352a-d239-451e-a3de-7c1d50767731 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.712508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e352a-d239-451e-a3de-7c1d50767731 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.712776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e352a-d239-451e-a3de-7c1d50767731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.752308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 631/1288] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:44.753296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabcc35-df46-4d62-a5df-3356179eabc0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.774146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:44.780310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e352a-d239-451e-a3de-7c1d50767731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.782432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e352a-d239-451e-a3de-7c1d50767731 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.794505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 658/1289] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:44.796266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e352a-d239-451e-a3de-7c1d50767731 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.824405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:44.843797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabcc35-df46-4d62-a5df-3356179eabc0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.849330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53686c24-5857-4669-9609-c7f7b03bad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.850095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53686c24-5857-4669-9609-c7f7b03bad0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.850439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53686c24-5857-4669-9609-c7f7b03bad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.850809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53686c24-5857-4669-9609-c7f7b03bad0c admin admin] PATH_INFO: `/v3/projects/5fe3225b2bc24f06b7969316d93ec141/users/a7af1f69b86640d1b131a274eb79b4a7/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.873356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e352a-d239-451e-a3de-7c1d50767731 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.873835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53686c24-5857-4669-9609-c7f7b03bad0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe3225b2bc24f06b7969316d93ec141, user_id=a7af1f69b86640d1b131a274eb79b4a7, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.877026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53686c24-5857-4669-9609-c7f7b03bad0c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.879601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435afd5-7441-4d83-ba23-6749bce1b5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.880367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435afd5-7441-4d83-ba23-6749bce1b5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.880651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435afd5-7441-4d83-ba23-6749bce1b5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.880932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435afd5-7441-4d83-ba23-6749bce1b5f5 admin admin] PATH_INFO: `/v3/projects/eb551584d4874e37aaa7585e6cfc10f0/users/2e9eb6b2ff274a8e810c3785a295e741/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.906702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 632/1290] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:44 2022] PUT /identity/v3/projects/5fe3225b2bc24f06b7969316d93ec141/users/a7af1f69b86640d1b131a274eb79b4a7/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:44.906940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435afd5-7441-4d83-ba23-6749bce1b5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb551584d4874e37aaa7585e6cfc10f0, user_id=2e9eb6b2ff274a8e810c3785a295e741, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.907028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aa4e1-5c2a-4c2d-96a6-97e6eddefe62 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.907028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aa4e1-5c2a-4c2d-96a6-97e6eddefe62 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.907028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aa4e1-5c2a-4c2d-96a6-97e6eddefe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.907302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435afd5-7441-4d83-ba23-6749bce1b5f5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.920835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 659/1291] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:44 2022] PUT /identity/v3/projects/eb551584d4874e37aaa7585e6cfc10f0/users/2e9eb6b2ff274a8e810c3785a295e741/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:44.924936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a54a-ae1b-46fa-92cb-36a87e72545a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.924936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a54a-ae1b-46fa-92cb-36a87e72545a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.924936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69a54a-ae1b-46fa-92cb-36a87e72545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.925710 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6e5aa4e1-5c2a-4c2d-96a6-97e6eddefe62 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:44.930826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6e5aa4e1-5c2a-4c2d-96a6-97e6eddefe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:44.945592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6b69a54a-ae1b-46fa-92cb-36a87e72545a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:44.947053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6b69a54a-ae1b-46fa-92cb-36a87e72545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:44.996739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 633/1292] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:45.001106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aa4e1-5c2a-4c2d-96a6-97e6eddefe62 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.002439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6e5aa4e1-5c2a-4c2d-96a6-97e6eddefe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.021148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 660/1293] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:45.022532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805ed5-67dc-4b27-abc0-691d3f514f70 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.022858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805ed5-67dc-4b27-abc0-691d3f514f70 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.023132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805ed5-67dc-4b27-abc0-691d3f514f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.044240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c4805ed5-67dc-4b27-abc0-691d3f514f70 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:45.045554 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c4805ed5-67dc-4b27-abc0-691d3f514f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.053697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 661/1294] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:45.056126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2444af6-c812-4842-bb50-c00cae5d984f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.056616 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2444af6-c812-4842-bb50-c00cae5d984f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.057066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2444af6-c812-4842-bb50-c00cae5d984f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.058355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 662/1295] 10.222.0.23 () {54 vars in 961 bytes} [Thu Oct 27 01:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:45.059385 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae4903-6e90-4c90-91f0-3a5e8ec33661 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.059664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae4903-6e90-4c90-91f0-3a5e8ec33661 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.059932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae4903-6e90-4c90-91f0-3a5e8ec33661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.074568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aa4e1-5c2a-4c2d-96a6-97e6eddefe62 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.078459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d65db-165e-422d-b38d-7dd2f62a9ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.079134 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d65db-165e-422d-b38d-7dd2f62a9ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.079433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d65db-165e-422d-b38d-7dd2f62a9ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.079713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d65db-165e-422d-b38d-7dd2f62a9ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.087911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d4ae4903-6e90-4c90-91f0-3a5e8ec33661 None None] MFA Rules not processed for user `a7af1f69b86640d1b131a274eb79b4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:45.088869 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d65db-165e-422d-b38d-7dd2f62a9ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.089109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d4ae4903-6e90-4c90-91f0-3a5e8ec33661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.090274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d65db-165e-422d-b38d-7dd2f62a9ea2 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.100271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 634/1296] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:45.101703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563639d-0ed5-4966-b650-98c5022f3a46 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.102146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563639d-0ed5-4966-b650-98c5022f3a46 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.102448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563639d-0ed5-4966-b650-98c5022f3a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.122129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b563639d-0ed5-4966-b650-98c5022f3a46 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:45.123276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b563639d-0ed5-4966-b650-98c5022f3a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.132983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 635/1297] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:45.133877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563639d-0ed5-4966-b650-98c5022f3a46 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.143541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563639d-0ed5-4966-b650-98c5022f3a46 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.147702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641869f1-2251-4c0b-8bd5-cc831a0daa1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.148315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641869f1-2251-4c0b-8bd5-cc831a0daa1e service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.148598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641869f1-2251-4c0b-8bd5-cc831a0daa1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.148876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641869f1-2251-4c0b-8bd5-cc831a0daa1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.158410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641869f1-2251-4c0b-8bd5-cc831a0daa1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.159907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641869f1-2251-4c0b-8bd5-cc831a0daa1e service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.169753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 636/1298] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:45.170575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641869f1-2251-4c0b-8bd5-cc831a0daa1e service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.172242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:45.179337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641869f1-2251-4c0b-8bd5-cc831a0daa1e service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.180063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 663/1299] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:45.181014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae4903-6e90-4c90-91f0-3a5e8ec33661 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.185338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750920-f411-4d2f-9595-1c6dc5d5c6ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.186004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750920-f411-4d2f-9595-1c6dc5d5c6ad service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.186328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750920-f411-4d2f-9595-1c6dc5d5c6ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.186738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750920-f411-4d2f-9595-1c6dc5d5c6ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.192912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae4903-6e90-4c90-91f0-3a5e8ec33661 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.198861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.199021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47750920-f411-4d2f-9595-1c6dc5d5c6ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.199506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.199777 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.200022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] PATH_INFO: `/v3/users/1ca5bd855f014799b077fdb766a272fe` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.200641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47750920-f411-4d2f-9595-1c6dc5d5c6ad service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.201216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca5bd855f014799b077fdb766a272fe)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.202291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:45.202291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: warnings.warn(msg) Oct 27 01:23:45.202291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: Oct 27 01:23:45.203659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.212474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 637/1300] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:45.213325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750920-f411-4d2f-9595-1c6dc5d5c6ad service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.221992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750920-f411-4d2f-9595-1c6dc5d5c6ad service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.226356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748649-a6bd-488f-80dc-900166c7e5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.227056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748649-a6bd-488f-80dc-900166c7e5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.227415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748649-a6bd-488f-80dc-900166c7e5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.227693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748649-a6bd-488f-80dc-900166c7e5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.246515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da748649-a6bd-488f-80dc-900166c7e5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.248519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da748649-a6bd-488f-80dc-900166c7e5e9 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.262373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 638/1301] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:45.263889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab6c24-6ddc-49ee-b229-76fccba35fcd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.264176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab6c24-6ddc-49ee-b229-76fccba35fcd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.264441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab6c24-6ddc-49ee-b229-76fccba35fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.277638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca5bd855f014799b077fdb766a272fe'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:45.289904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca5bd855f014799b077fdb766a272fe'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:45.308945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca5bd855f014799b077fdb766a272fe'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:45.310015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca5bd855f014799b077fdb766a272fe'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:45.313491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-15ab6c24-6ddc-49ee-b229-76fccba35fcd None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:45.315147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-15ab6c24-6ddc-49ee-b229-76fccba35fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.328051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:45.335898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca5bd855f014799b077fdb766a272fe'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:45.350361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 664/1302] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:23:45 2022] DELETE /identity/v3/users/1ca5bd855f014799b077fdb766a272fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:45.350361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.350641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.431811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 639/1303] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Oct 27 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:45.433623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab6c24-6ddc-49ee-b229-76fccba35fcd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.435228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-15ab6c24-6ddc-49ee-b229-76fccba35fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.436357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96ab28-3bb4-48e7-b0b2-b0b5e72bba8d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.442000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b50075-379f-467e-92fb-c4c4b0bc3f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.443831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b50075-379f-467e-92fb-c4c4b0bc3f34 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.444335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b50075-379f-467e-92fb-c4c4b0bc3f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.444796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b50075-379f-467e-92fb-c4c4b0bc3f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.447677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c1b50075-379f-467e-92fb-c4c4b0bc3f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.451975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab6c24-6ddc-49ee-b229-76fccba35fcd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.552534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b50075-379f-467e-92fb-c4c4b0bc3f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.553477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a58f7c-07c1-4582-aa18-68918fb634c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.554218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a58f7c-07c1-4582-aa18-68918fb634c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.554501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a58f7c-07c1-4582-aa18-68918fb634c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.554807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a58f7c-07c1-4582-aa18-68918fb634c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.555659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b50075-379f-467e-92fb-c4c4b0bc3f34 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.555831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a58f7c-07c1-4582-aa18-68918fb634c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.558246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a58f7c-07c1-4582-aa18-68918fb634c2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.570881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 665/1304] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:45.572600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2d2d1-7612-4c9f-8341-7278b2e1eabb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.573138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2d2d1-7612-4c9f-8341-7278b2e1eabb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.573624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2d2d1-7612-4c9f-8341-7278b2e1eabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.605683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 640/1305] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:45 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:45.608466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7dd2d2d1-7612-4c9f-8341-7278b2e1eabb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:45.609964 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a58f7c-07c1-4582-aa18-68918fb634c2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.610066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7dd2d2d1-7612-4c9f-8341-7278b2e1eabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.640619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:45.707862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 666/1306] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:45.707862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2d2d1-7612-4c9f-8341-7278b2e1eabb None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.719061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2d2d1-7612-4c9f-8341-7278b2e1eabb None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.723031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eae65-1f08-4518-b0b6-d12223ed4b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.723675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eae65-1f08-4518-b0b6-d12223ed4b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.723955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eae65-1f08-4518-b0b6-d12223ed4b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.724227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eae65-1f08-4518-b0b6-d12223ed4b9a admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.724956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429eae65-1f08-4518-b0b6-d12223ed4b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.726978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429eae65-1f08-4518-b0b6-d12223ed4b9a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.736140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a58f7c-07c1-4582-aa18-68918fb634c2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.748228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14efb-3a50-4d11-9895-ecf421d6407f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.749113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14efb-3a50-4d11-9895-ecf421d6407f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.749511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14efb-3a50-4d11-9895-ecf421d6407f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.750284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14efb-3a50-4d11-9895-ecf421d6407f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.752950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-48f14efb-3a50-4d11-9895-ecf421d6407f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:45.757208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 667/1307] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:45 2022] POST /identity/v3/users => generated 295 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:45.762426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eae65-1f08-4518-b0b6-d12223ed4b9a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.773657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eae65-1f08-4518-b0b6-d12223ed4b9a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.778612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32d874-1a48-4df8-ab82-699e1a1d5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.779274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d874-1a48-4df8-ab82-699e1a1d5a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.779552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d874-1a48-4df8-ab82-699e1a1d5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.779824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d874-1a48-4df8-ab82-699e1a1d5a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.780476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32d874-1a48-4df8-ab82-699e1a1d5a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.782096 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32d874-1a48-4df8-ab82-699e1a1d5a17 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.796655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 668/1308] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:45.798186 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32d874-1a48-4df8-ab82-699e1a1d5a17 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.799246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:45.832387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32d874-1a48-4df8-ab82-699e1a1d5a17 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:45.845338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14efb-3a50-4d11-9895-ecf421d6407f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.847218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cfbf7-5037-4cfa-b219-9a767b4c3342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:45.848057 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14efb-3a50-4d11-9895-ecf421d6407f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.848334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cfbf7-5037-4cfa-b219-9a767b4c3342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:45.848751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cfbf7-5037-4cfa-b219-9a767b4c3342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:45.849135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cfbf7-5037-4cfa-b219-9a767b4c3342 admin admin] PATH_INFO: `/v3/projects/6b0600b2aeb14e12ae723cc5fec664de/users/3ab1f4b9a8d749ef8a9cb7ee62061ff8/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:45.872199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cfbf7-5037-4cfa-b219-9a767b4c3342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0600b2aeb14e12ae723cc5fec664de, user_id=3ab1f4b9a8d749ef8a9cb7ee62061ff8, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:45.872507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 641/1309] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:45.874213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14efb-3a50-4d11-9895-ecf421d6407f service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.877665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cfbf7-5037-4cfa-b219-9a767b4c3342 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:45.903387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 669/1310] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:45 2022] PUT /identity/v3/projects/6b0600b2aeb14e12ae723cc5fec664de/users/3ab1f4b9a8d749ef8a9cb7ee62061ff8/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:45.906306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cfbf7-5037-4cfa-b219-9a767b4c3342 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:45.992399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14efb-3a50-4d11-9895-ecf421d6407f service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:46.032032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cfbf7-5037-4cfa-b219-9a767b4c3342 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:46.041316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630c38-818c-4810-aeed-cf2b5199116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:46.042002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630c38-818c-4810-aeed-cf2b5199116d admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:46.042910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630c38-818c-4810-aeed-cf2b5199116d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:46.043355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630c38-818c-4810-aeed-cf2b5199116d admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:46.044070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93630c38-818c-4810-aeed-cf2b5199116d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:46.045759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93630c38-818c-4810-aeed-cf2b5199116d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:46.061359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 670/1311] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:46.066305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630c38-818c-4810-aeed-cf2b5199116d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:46.081060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630c38-818c-4810-aeed-cf2b5199116d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:46.084730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a6c4b-6d59-4c03-9f60-02a51601a398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:46.085372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a6c4b-6d59-4c03-9f60-02a51601a398 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:46.085675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a6c4b-6d59-4c03-9f60-02a51601a398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:46.085929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a6c4b-6d59-4c03-9f60-02a51601a398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:46.094633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e307293-3599-4fe7-846a-a16b4824e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:46.096096 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e307293-3599-4fe7-846a-a16b4824e0df admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:46.096579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e307293-3599-4fe7-846a-a16b4824e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:46.097023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e307293-3599-4fe7-846a-a16b4824e0df admin admin] PATH_INFO: `/v3/projects/6b0600b2aeb14e12ae723cc5fec664de/users/3ab1f4b9a8d749ef8a9cb7ee62061ff8/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:46.101413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e307293-3599-4fe7-846a-a16b4824e0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0600b2aeb14e12ae723cc5fec664de, user_id=3ab1f4b9a8d749ef8a9cb7ee62061ff8, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:46.106677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e307293-3599-4fe7-846a-a16b4824e0df admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:46.107524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a6c4b-6d59-4c03-9f60-02a51601a398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:46.109062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a6c4b-6d59-4c03-9f60-02a51601a398 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:46.133772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 671/1312] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:46 2022] PUT /identity/v3/projects/6b0600b2aeb14e12ae723cc5fec664de/users/3ab1f4b9a8d749ef8a9cb7ee62061ff8/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:46.135701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 642/1313] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:46.144114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84d14-7567-419b-a01e-b443227adab6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:46.144487 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84d14-7567-419b-a01e-b443227adab6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:46.144836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84d14-7567-419b-a01e-b443227adab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:46.174874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d5b84d14-7567-419b-a01e-b443227adab6 None None] MFA Rules not processed for user `3ab1f4b9a8d749ef8a9cb7ee62061ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:46.176268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d5b84d14-7567-419b-a01e-b443227adab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:46.226318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:46.242747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a74e-22d7-4dc4-9a70-6523ed5e18e5 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:46.242948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a74e-22d7-4dc4-9a70-6523ed5e18e5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:46.243232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a74e-22d7-4dc4-9a70-6523ed5e18e5 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:46.244861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 643/1314] 10.222.0.23 () {54 vars in 912 bytes} [Thu Oct 27 01:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:23:46.251111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6ef8-d6ef-4aa5-91e3-732e75e80be5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:46.251403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6ef8-d6ef-4aa5-91e3-732e75e80be5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:46.251760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6ef8-d6ef-4aa5-91e3-732e75e80be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:46.274013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6cac6ef8-d6ef-4aa5-91e3-732e75e80be5 None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:46.275376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6cac6ef8-d6ef-4aa5-91e3-732e75e80be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:46.298100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 672/1315] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:46.309126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84d14-7567-419b-a01e-b443227adab6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:46.310603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d5b84d14-7567-419b-a01e-b443227adab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:46.390517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84d14-7567-419b-a01e-b443227adab6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:46.403367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 644/1316] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:46.404637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7badba-7577-428a-b2e0-a5466b80a6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:46.405476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7badba-7577-428a-b2e0-a5466b80a6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:46.405755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7badba-7577-428a-b2e0-a5466b80a6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:46.406024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7badba-7577-428a-b2e0-a5466b80a6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:46.407900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5a7badba-7577-428a-b2e0-a5466b80a6c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:46.428760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac6ef8-d6ef-4aa5-91e3-732e75e80be5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:46.434116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6cac6ef8-d6ef-4aa5-91e3-732e75e80be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:46.451759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac6ef8-d6ef-4aa5-91e3-732e75e80be5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:46.457833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38979f6-37b2-489c-a96f-87a39ccb4e68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:46.458803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38979f6-37b2-489c-a96f-87a39ccb4e68 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:46.459290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38979f6-37b2-489c-a96f-87a39ccb4e68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:46.459671 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38979f6-37b2-489c-a96f-87a39ccb4e68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:46.475287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38979f6-37b2-489c-a96f-87a39ccb4e68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:46.477243 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38979f6-37b2-489c-a96f-87a39ccb4e68 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:46.487083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7badba-7577-428a-b2e0-a5466b80a6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:46.489981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7badba-7577-428a-b2e0-a5466b80a6c5 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:46.502743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 673/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:46.502988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 645/1318] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:46.658804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72fc42-6973-44ad-be30-ee0bc2587c14 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:46.659184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72fc42-6973-44ad-be30-ee0bc2587c14 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:46.659516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72fc42-6973-44ad-be30-ee0bc2587c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:46.720533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-de72fc42-6973-44ad-be30-ee0bc2587c14 None None] MFA Rules not processed for user `b61f3548f1254a289eba50b86071aae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:46.726203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-de72fc42-6973-44ad-be30-ee0bc2587c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:46.860261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 674/1319] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:46.864975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38979f6-37b2-489c-a96f-87a39ccb4e68 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:46.866501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e38979f6-37b2-489c-a96f-87a39ccb4e68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:46.873965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:47.026378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38979f6-37b2-489c-a96f-87a39ccb4e68 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:47.031719 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65ba76-c957-4fa5-95f7-7229a15b6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:47.032386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65ba76-c957-4fa5-95f7-7229a15b6d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:47.032671 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65ba76-c957-4fa5-95f7-7229a15b6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:47.032939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65ba76-c957-4fa5-95f7-7229a15b6d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:47.033599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65ba76-c957-4fa5-95f7-7229a15b6d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:47.035788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65ba76-c957-4fa5-95f7-7229a15b6d75 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:47.101054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72fc42-6973-44ad-be30-ee0bc2587c14 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:47.102731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 646/1320] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:46 2022] POST /identity/v3/projects => generated 403 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:47.115959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72fc42-6973-44ad-be30-ee0bc2587c14 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:47.162196 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:47.271665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fafa07-e1c7-48c6-b73b-da985d275a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:47.273710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fafa07-e1c7-48c6-b73b-da985d275a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:47.275334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fafa07-e1c7-48c6-b73b-da985d275a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:47.275334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fafa07-e1c7-48c6-b73b-da985d275a40 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:47.275509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fafa07-e1c7-48c6-b73b-da985d275a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:47.295599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fafa07-e1c7-48c6-b73b-da985d275a40 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:47.362757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 675/1321] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:47 2022] POST /identity/v3/users => generated 308 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:23:47.366362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65ba76-c957-4fa5-95f7-7229a15b6d75 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:47.384692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65ba76-c957-4fa5-95f7-7229a15b6d75 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:47.399901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d76fc-e1c1-4193-94c8-1fb7be3718f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:47.401569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d76fc-e1c1-4193-94c8-1fb7be3718f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:47.403179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d76fc-e1c1-4193-94c8-1fb7be3718f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:47.403681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d76fc-e1c1-4193-94c8-1fb7be3718f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:47.406428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d76fc-e1c1-4193-94c8-1fb7be3718f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:47.411933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d76fc-e1c1-4193-94c8-1fb7be3718f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:47.457392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 647/1322] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:47.461005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fafa07-e1c7-48c6-b73b-da985d275a40 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:47.478484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fafa07-e1c7-48c6-b73b-da985d275a40 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:47.494570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c467ae-2258-4427-a67b-c1cd4261eaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:47.495615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c467ae-2258-4427-a67b-c1cd4261eaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:47.495615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c467ae-2258-4427-a67b-c1cd4261eaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:47.497374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c467ae-2258-4427-a67b-c1cd4261eaf7 admin admin] PATH_INFO: `/v3/projects/1d934e09483e4c29ae1069925f1ef812/users/aac2814bfe6c4b40954b7908c99e9f31/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:47.544714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c467ae-2258-4427-a67b-c1cd4261eaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d934e09483e4c29ae1069925f1ef812, user_id=aac2814bfe6c4b40954b7908c99e9f31, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:47.553584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c467ae-2258-4427-a67b-c1cd4261eaf7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:47.583009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 676/1323] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:47 2022] PUT /identity/v3/projects/1d934e09483e4c29ae1069925f1ef812/users/aac2814bfe6c4b40954b7908c99e9f31/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:47.588104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d76fc-e1c1-4193-94c8-1fb7be3718f6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:47.611023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d76fc-e1c1-4193-94c8-1fb7be3718f6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:47.773083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c467ae-2258-4427-a67b-c1cd4261eaf7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:47.775090 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d7af-22d5-4661-b81b-def252d2876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:47.775673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c6c467ae-2258-4427-a67b-c1cd4261eaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:47.777268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d7af-22d5-4661-b81b-def252d2876e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:47.780412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d7af-22d5-4661-b81b-def252d2876e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:47.780918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d7af-22d5-4661-b81b-def252d2876e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:47.781884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47d7af-22d5-4661-b81b-def252d2876e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:47.784375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47d7af-22d5-4661-b81b-def252d2876e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:47.814118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 648/1324] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:47.815481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c467ae-2258-4427-a67b-c1cd4261eaf7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:47.818941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d7af-22d5-4661-b81b-def252d2876e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:47.848898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:47.848898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:47.849184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:47.849268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] PATH_INFO: `/v3/projects/98f025aa827044ee89ad72a185279955` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:47.849360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d7af-22d5-4661-b81b-def252d2876e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:47.862213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f025aa827044ee89ad72a185279955)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:47.869630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a831e-d052-4401-89b8-c0148ef1987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:47.869831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:47.870385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a831e-d052-4401-89b8-c0148ef1987b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:47.871130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a831e-d052-4401-89b8-c0148ef1987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:47.871130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a831e-d052-4401-89b8-c0148ef1987b admin admin] PATH_INFO: `/v3/projects/1d934e09483e4c29ae1069925f1ef812/users/aac2814bfe6c4b40954b7908c99e9f31/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:47.878275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a831e-d052-4401-89b8-c0148ef1987b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d934e09483e4c29ae1069925f1ef812, user_id=aac2814bfe6c4b40954b7908c99e9f31, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:47.883962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a831e-d052-4401-89b8-c0148ef1987b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:47.917214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 649/1325] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:47 2022] PUT /identity/v3/projects/1d934e09483e4c29ae1069925f1ef812/users/aac2814bfe6c4b40954b7908c99e9f31/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:48.024000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f025aa827044ee89ad72a185279955', 'request_id': 'req-28083042-b859-4904-9fae-34d6536dcaaa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.043822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f025aa827044ee89ad72a185279955', 'request_id': 'req-28083042-b859-4904-9fae-34d6536dcaaa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.059361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f025aa827044ee89ad72a185279955', 'request_id': 'req-28083042-b859-4904-9fae-34d6536dcaaa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.087207 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] The token cache is being invalidate because project 98f025aa827044ee89ad72a185279955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:23:48.087504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.088233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-28083042-b859-4904-9fae-34d6536dcaaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.090175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 677/1326] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:23:47 2022] DELETE /identity/v3/projects/98f025aa827044ee89ad72a185279955 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:23:48.094100 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a831e-d052-4401-89b8-c0148ef1987b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:48.095904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-344a831e-d052-4401-89b8-c0148ef1987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:48.245737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a831e-d052-4401-89b8-c0148ef1987b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:48.254444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e11a0d-c939-46ec-abd7-80b0722c1349 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:48.255365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:48.255543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e11a0d-c939-46ec-abd7-80b0722c1349 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:48.255965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e11a0d-c939-46ec-abd7-80b0722c1349 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:48.257913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 678/1327] 10.222.0.23 () {54 vars in 961 bytes} [Thu Oct 27 01:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:23:48.268868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dffb67-37aa-414e-a881-4ce82ef6931b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:48.269441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dffb67-37aa-414e-a881-4ce82ef6931b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:48.269870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dffb67-37aa-414e-a881-4ce82ef6931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:48.313312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f9dffb67-37aa-414e-a881-4ce82ef6931b None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:48.316169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f9dffb67-37aa-414e-a881-4ce82ef6931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:48.392317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:48.393401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:48.393846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:48.394314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] PATH_INFO: `/v3/users/d17afade8e824430b1bc9b28bd114a8c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:48.396941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17afade8e824430b1bc9b28bd114a8c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:48.399328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:48.471153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 679/1328] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Oct 27 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:48.480848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2de14-5426-4708-a180-834aaec6b265 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:48.482299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2de14-5426-4708-a180-834aaec6b265 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:48.483297 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2de14-5426-4708-a180-834aaec6b265 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:48.490881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 680/1329] 10.222.0.23 () {54 vars in 912 bytes} [Thu Oct 27 01:23:48 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:48.497400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c7c3-a173-48a0-882b-742f42e24369 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:48.498202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c7c3-a173-48a0-882b-742f42e24369 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:48.499046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c7c3-a173-48a0-882b-742f42e24369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:48.515915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17afade8e824430b1bc9b28bd114a8c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.523319 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:48.540007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17afade8e824430b1bc9b28bd114a8c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.559124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b501c7c3-a173-48a0-882b-742f42e24369 None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:48.563006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b501c7c3-a173-48a0-882b-742f42e24369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:48.577558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17afade8e824430b1bc9b28bd114a8c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.591063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 681/1330] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:48.596629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17afade8e824430b1bc9b28bd114a8c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.597424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17afade8e824430b1bc9b28bd114a8c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:48.603974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501c7c3-a173-48a0-882b-742f42e24369 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:48.606262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b501c7c3-a173-48a0-882b-742f42e24369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:48.612691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 650/1331] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:23:48 2022] DELETE /identity/v3/users/d17afade8e824430b1bc9b28bd114a8c => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:48.661753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:48.663817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:48.742118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501c7c3-a173-48a0-882b-742f42e24369 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:48.826783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316060ee-3b86-4d43-95d8-09c20698ea08 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:48.846271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:48.847570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:48.847986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:48.848375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:48.851518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:48.873218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b17c-9932-42e3-b309-451dd46597b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:48.873864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b17c-9932-42e3-b309-451dd46597b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:48.874144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b17c-9932-42e3-b309-451dd46597b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:48.874417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b17c-9932-42e3-b309-451dd46597b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:48.879464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6083b17c-9932-42e3-b309-451dd46597b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:48.917157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:48.959372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:48.961333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:48.974171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 651/1332] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:23:49.040217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083b17c-9932-42e3-b309-451dd46597b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:49.042587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083b17c-9932-42e3-b309-451dd46597b0 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:49.058699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 682/1333] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:49.553774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:49.556254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:49.709705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713b575-4b18-4a72-bbce-064398cbbec4 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:49.719658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:49.720406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:49.720687 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:49.720963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] PATH_INFO: `/v3/projects/b0b42de3a3a54b86affd3c92e760a7be` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:49.722236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b42de3a3a54b86affd3c92e760a7be)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:49.723645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:23:49.723645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: warnings.warn(msg) Oct 27 01:23:49.723645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: Oct 27 01:23:49.725741 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:49.856719 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b42de3a3a54b86affd3c92e760a7be', 'request_id': 'req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:49.895994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b42de3a3a54b86affd3c92e760a7be', 'request_id': 'req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:49.931781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b42de3a3a54b86affd3c92e760a7be', 'request_id': 'req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:49.972948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] The token cache is being invalidate because project b0b42de3a3a54b86affd3c92e760a7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:23:49.973260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:49.974041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a01d73d6-6d1c-485c-9bb4-ab67192ec6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:49.982278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 652/1334] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:23:49 2022] DELETE /identity/v3/projects/b0b42de3a3a54b86affd3c92e760a7be => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:49.989264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6709-07ce-40d4-8500-249d41e10375 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:49.989721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6709-07ce-40d4-8500-249d41e10375 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:49.989946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6709-07ce-40d4-8500-249d41e10375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:50.042558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4e6c6709-07ce-40d4-8500-249d41e10375 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:50.043998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4e6c6709-07ce-40d4-8500-249d41e10375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:50.115033 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:50.143152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430b9f8-e663-418d-ab80-2f1568a5f110 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:50.143421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 683/1335] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:50.143539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430b9f8-e663-418d-ab80-2f1568a5f110 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:50.143797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430b9f8-e663-418d-ab80-2f1568a5f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:50.177162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5430b9f8-e663-418d-ab80-2f1568a5f110 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:50.179150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5430b9f8-e663-418d-ab80-2f1568a5f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:50.201248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6709-07ce-40d4-8500-249d41e10375 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:50.203291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 653/1336] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:50.216924 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6709-07ce-40d4-8500-249d41e10375 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:50.225194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4afbe-d828-49f0-9730-c5273e1a84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:50.226264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4afbe-d828-49f0-9730-c5273e1a84d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:50.226550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4afbe-d828-49f0-9730-c5273e1a84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:50.226892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4afbe-d828-49f0-9730-c5273e1a84d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:50.227624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4afbe-d828-49f0-9730-c5273e1a84d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:50.228557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4afbe-d828-49f0-9730-c5273e1a84d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:50.231610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4afbe-d828-49f0-9730-c5273e1a84d5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:50.259031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 684/1337] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:50.259707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430b9f8-e663-418d-ab80-2f1568a5f110 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:50.277274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430b9f8-e663-418d-ab80-2f1568a5f110 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:50.289817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c011efd-5369-481a-998f-70404c677d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:50.290651 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c011efd-5369-481a-998f-70404c677d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:50.290888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c011efd-5369-481a-998f-70404c677d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:50.291168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c011efd-5369-481a-998f-70404c677d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:50.291819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c011efd-5369-481a-998f-70404c677d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:50.293759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c011efd-5369-481a-998f-70404c677d63 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:50.355529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 654/1338] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:50 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:50.361619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4afbe-d828-49f0-9730-c5273e1a84d5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:50.379686 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4afbe-d828-49f0-9730-c5273e1a84d5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:50.561895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa72f7a-c1e8-4717-b2a3-94cccb23e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:50.562639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa72f7a-c1e8-4717-b2a3-94cccb23e036 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:50.565728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa72f7a-c1e8-4717-b2a3-94cccb23e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:50.566069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa72f7a-c1e8-4717-b2a3-94cccb23e036 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:50.566849 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa72f7a-c1e8-4717-b2a3-94cccb23e036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:50.568847 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa72f7a-c1e8-4717-b2a3-94cccb23e036 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:50.620200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c011efd-5369-481a-998f-70404c677d63 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:50.636762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 685/1339] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:50 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:50.652829 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c011efd-5369-481a-998f-70404c677d63 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:50.659185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42602f4a-3e0a-45d6-bb8d-4fd3354bc96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:50.660195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42602f4a-3e0a-45d6-bb8d-4fd3354bc96e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:50.660646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42602f4a-3e0a-45d6-bb8d-4fd3354bc96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:50.661317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42602f4a-3e0a-45d6-bb8d-4fd3354bc96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:50.663752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42602f4a-3e0a-45d6-bb8d-4fd3354bc96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:50.666398 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42602f4a-3e0a-45d6-bb8d-4fd3354bc96e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:50.686402 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 655/1340] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:50.692014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa72f7a-c1e8-4717-b2a3-94cccb23e036 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:50.717407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa72f7a-c1e8-4717-b2a3-94cccb23e036 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:50.785064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e39f5-3ae1-4386-b36c-dc75ce8a78cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:50.786359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e39f5-3ae1-4386-b36c-dc75ce8a78cf admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:50.786831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e39f5-3ae1-4386-b36c-dc75ce8a78cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:50.787275 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e39f5-3ae1-4386-b36c-dc75ce8a78cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:50.801471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e39f5-3ae1-4386-b36c-dc75ce8a78cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:50.808738 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e39f5-3ae1-4386-b36c-dc75ce8a78cf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:50.846770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 686/1341] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:50.847376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42602f4a-3e0a-45d6-bb8d-4fd3354bc96e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:50.863955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42602f4a-3e0a-45d6-bb8d-4fd3354bc96e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:50.876573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b1e12-3711-4f51-908b-bdaf7fe28c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:50.878737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b1e12-3711-4f51-908b-bdaf7fe28c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:50.879362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b1e12-3711-4f51-908b-bdaf7fe28c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:50.883471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b1e12-3711-4f51-908b-bdaf7fe28c1c admin admin] PATH_INFO: `/v3/projects/dc795c56c4ec476999855dd63de5ffc7/users/719c5882573e4413835572965072c554/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:50.909559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b1e12-3711-4f51-908b-bdaf7fe28c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc795c56c4ec476999855dd63de5ffc7, user_id=719c5882573e4413835572965072c554, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:50.914307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b1e12-3711-4f51-908b-bdaf7fe28c1c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:50.950842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 656/1342] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:50 2022] PUT /identity/v3/projects/dc795c56c4ec476999855dd63de5ffc7/users/719c5882573e4413835572965072c554/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:23:50.951206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8fff9-d2c2-4a05-8832-020690d4bf47 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:50.951547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8fff9-d2c2-4a05-8832-020690d4bf47 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:50.951747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8fff9-d2c2-4a05-8832-020690d4bf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:51.015824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8ce8fff9-d2c2-4a05-8832-020690d4bf47 None None] MFA Rules not processed for user `719c5882573e4413835572965072c554`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:51.017060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8ce8fff9-d2c2-4a05-8832-020690d4bf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:51.215947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 687/1343] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:51.217379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b1e12-3711-4f51-908b-bdaf7fe28c1c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:51.229463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:51.347398 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b1e12-3711-4f51-908b-bdaf7fe28c1c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:51.359425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8f44a-5249-41b1-9d9e-cd84bf314c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:51.360591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f44a-5249-41b1-9d9e-cd84bf314c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:51.361126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f44a-5249-41b1-9d9e-cd84bf314c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:51.362272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f44a-5249-41b1-9d9e-cd84bf314c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:51.364361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8f44a-5249-41b1-9d9e-cd84bf314c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:51.369035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8f44a-5249-41b1-9d9e-cd84bf314c3d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:51.433823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 657/1344] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:51 2022] POST /identity/v3/projects => generated 363 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:51.437655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8fff9-d2c2-4a05-8832-020690d4bf47 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:51.464485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8fff9-d2c2-4a05-8832-020690d4bf47 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:51.558735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48ee91-2b11-471a-b19b-8581cf2b6df1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:51.558735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48ee91-2b11-471a-b19b-8581cf2b6df1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:51.559064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48ee91-2b11-471a-b19b-8581cf2b6df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:51.635279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:51.674927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0c48ee91-2b11-471a-b19b-8581cf2b6df1 None None] MFA Rules not processed for user `aac2814bfe6c4b40954b7908c99e9f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:51.676253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0c48ee91-2b11-471a-b19b-8581cf2b6df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:51.696244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f419e89-13a6-4c6f-a1e9-64dc8db145fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:51.696904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f419e89-13a6-4c6f-a1e9-64dc8db145fe admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:51.697185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f419e89-13a6-4c6f-a1e9-64dc8db145fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:51.701521 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f419e89-13a6-4c6f-a1e9-64dc8db145fe admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:51.705052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f419e89-13a6-4c6f-a1e9-64dc8db145fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:51.712955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f419e89-13a6-4c6f-a1e9-64dc8db145fe admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:51.783713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 688/1345] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:51 2022] POST /identity/v3/users => generated 288 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:51.784998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f419e89-13a6-4c6f-a1e9-64dc8db145fe admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:51.802829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f419e89-13a6-4c6f-a1e9-64dc8db145fe admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:51.810996 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bb1ef-c36d-4cf6-b5da-72ec16ed321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:51.812194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bb1ef-c36d-4cf6-b5da-72ec16ed321b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:51.812808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bb1ef-c36d-4cf6-b5da-72ec16ed321b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:51.813319 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bb1ef-c36d-4cf6-b5da-72ec16ed321b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:51.814867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bb1ef-c36d-4cf6-b5da-72ec16ed321b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:51.817048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bb1ef-c36d-4cf6-b5da-72ec16ed321b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:51.833244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 689/1346] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:51.846698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bb1ef-c36d-4cf6-b5da-72ec16ed321b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:51.864248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bb1ef-c36d-4cf6-b5da-72ec16ed321b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:51.871643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dba88-b12c-4722-8bf2-1ba991ba148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:51.872805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dba88-b12c-4722-8bf2-1ba991ba148c admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:51.873344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dba88-b12c-4722-8bf2-1ba991ba148c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:51.873833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dba88-b12c-4722-8bf2-1ba991ba148c admin admin] PATH_INFO: `/v3/projects/22548950571c456fad04129a6c12f886/users/c4eaebd7109e4898a54811c6a8e3dde1/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:51.899961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dba88-b12c-4722-8bf2-1ba991ba148c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22548950571c456fad04129a6c12f886, user_id=c4eaebd7109e4898a54811c6a8e3dde1, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:51.903654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dba88-b12c-4722-8bf2-1ba991ba148c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:51.934418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 690/1347] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:51 2022] PUT /identity/v3/projects/22548950571c456fad04129a6c12f886/users/c4eaebd7109e4898a54811c6a8e3dde1/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:51.934418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dba88-b12c-4722-8bf2-1ba991ba148c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:51.935086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 658/1348] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:52.095635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dba88-b12c-4722-8bf2-1ba991ba148c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:52.108124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017cb6f-80f3-461d-8ec4-d2a4ecccaadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:52.108778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017cb6f-80f3-461d-8ec4-d2a4ecccaadd admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:52.109062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017cb6f-80f3-461d-8ec4-d2a4ecccaadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:52.109343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017cb6f-80f3-461d-8ec4-d2a4ecccaadd admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:52.110192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017cb6f-80f3-461d-8ec4-d2a4ecccaadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:52.111681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017cb6f-80f3-461d-8ec4-d2a4ecccaadd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:52.135921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 691/1349] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:23:52.141771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48ee91-2b11-471a-b19b-8581cf2b6df1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:52.169939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48ee91-2b11-471a-b19b-8581cf2b6df1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:52.185896 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5d07-65bb-4cd2-b38e-6fb543d343e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:52.187058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5d07-65bb-4cd2-b38e-6fb543d343e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:52.187778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5d07-65bb-4cd2-b38e-6fb543d343e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:52.188281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5d07-65bb-4cd2-b38e-6fb543d343e9 admin admin] PATH_INFO: `/v3/projects/22548950571c456fad04129a6c12f886/users/c4eaebd7109e4898a54811c6a8e3dde1/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:52.191234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b5d07-65bb-4cd2-b38e-6fb543d343e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22548950571c456fad04129a6c12f886, user_id=c4eaebd7109e4898a54811c6a8e3dde1, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:52.194508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b5d07-65bb-4cd2-b38e-6fb543d343e9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:52.244044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 659/1350] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:23:52 2022] PUT /identity/v3/projects/22548950571c456fad04129a6c12f886/users/c4eaebd7109e4898a54811c6a8e3dde1/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:52.259552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249496cf-a79d-4a5a-b549-7941abc954d3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:52.259957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249496cf-a79d-4a5a-b549-7941abc954d3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:52.260367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249496cf-a79d-4a5a-b549-7941abc954d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:52.301177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-249496cf-a79d-4a5a-b549-7941abc954d3 None None] MFA Rules not processed for user `c4eaebd7109e4898a54811c6a8e3dde1`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:52.302413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-249496cf-a79d-4a5a-b549-7941abc954d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:52.447134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 692/1351] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:52.453362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5d07-65bb-4cd2-b38e-6fb543d343e9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:52.455259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d76b5d07-65bb-4cd2-b38e-6fb543d343e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:52.664457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5d07-65bb-4cd2-b38e-6fb543d343e9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:52.670547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12bd03-d171-4244-96cd-a4d54da212e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:52.671552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12bd03-d171-4244-96cd-a4d54da212e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:52.671691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12bd03-d171-4244-96cd-a4d54da212e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:52.671918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12bd03-d171-4244-96cd-a4d54da212e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:52.687619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12bd03-d171-4244-96cd-a4d54da212e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:52.689726 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12bd03-d171-4244-96cd-a4d54da212e0 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:52.715356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 660/1352] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:53.824862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249496cf-a79d-4a5a-b549-7941abc954d3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:53.876501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:53.906405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12bd03-d171-4244-96cd-a4d54da212e0 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:53.911923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ef12bd03-d171-4244-96cd-a4d54da212e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:53.928213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:54.007583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249496cf-a79d-4a5a-b549-7941abc954d3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:54.018285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:54.019213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.019495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.019765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] PATH_INFO: `/v3/users/719c5882573e4413835572965072c554` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:54.022448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=719c5882573e4413835572965072c554)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:54.024463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:54.044261 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12bd03-d171-4244-96cd-a4d54da212e0 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:54.050907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:54.052865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.053368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.054450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] PATH_INFO: `/v3/users/a786f92c9ac34323b919703c322c7df8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:54.059335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a786f92c9ac34323b919703c322c7df8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:54.062441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:54.112926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719c5882573e4413835572965072c554'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.126195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719c5882573e4413835572965072c554'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.138615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719c5882573e4413835572965072c554'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.140395 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719c5882573e4413835572965072c554'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.157954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a786f92c9ac34323b919703c322c7df8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.162170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-050f10da-3785-4b3c-80e3-c3a2d8a12dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719c5882573e4413835572965072c554'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.170795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a786f92c9ac34323b919703c322c7df8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.178810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 693/1353] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:23:53 2022] DELETE /identity/v3/users/719c5882573e4413835572965072c554 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:54.182190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06e534-bacc-49ac-88d4-6499cb959659 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.182650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06e534-bacc-49ac-88d4-6499cb959659 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.183094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06e534-bacc-49ac-88d4-6499cb959659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:54.199974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a786f92c9ac34323b919703c322c7df8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.212268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a786f92c9ac34323b919703c322c7df8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.213029 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ef14d80-f16a-4d42-a633-39f2fb5855a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a786f92c9ac34323b919703c322c7df8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.216007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5f06e534-bacc-49ac-88d4-6499cb959659 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:54.217670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5f06e534-bacc-49ac-88d4-6499cb959659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:54.224659 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 661/1354] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:23:53 2022] DELETE /identity/v3/users/a786f92c9ac34323b919703c322c7df8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:54.229421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47566a-ed2c-4a70-b470-55b1cc02e769 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.245529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47566a-ed2c-4a70-b470-55b1cc02e769 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.246068 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47566a-ed2c-4a70-b470-55b1cc02e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:54.297039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5f47566a-ed2c-4a70-b470-55b1cc02e769 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:54.299458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5f47566a-ed2c-4a70-b470-55b1cc02e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:54.363363 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 694/1355] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:54.364067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06e534-bacc-49ac-88d4-6499cb959659 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:54.371092 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5f06e534-bacc-49ac-88d4-6499cb959659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:54.414987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06e534-bacc-49ac-88d4-6499cb959659 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:54.446247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 662/1356] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:54.527854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:54.534487 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47566a-ed2c-4a70-b470-55b1cc02e769 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:54.535998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5f47566a-ed2c-4a70-b470-55b1cc02e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:54.591029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:54.591714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.591996 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.592784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] PATH_INFO: `/v3/users/a7af1f69b86640d1b131a274eb79b4a7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:54.600316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7af1f69b86640d1b131a274eb79b4a7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:54.611749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:54.619674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:54.751181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47566a-ed2c-4a70-b470-55b1cc02e769 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:54.769631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94e4e2-e40c-47a8-8797-f97906c943c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:54.770442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94e4e2-e40c-47a8-8797-f97906c943c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.770795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94e4e2-e40c-47a8-8797-f97906c943c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.771075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94e4e2-e40c-47a8-8797-f97906c943c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:54.791240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7af1f69b86640d1b131a274eb79b4a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.796993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94e4e2-e40c-47a8-8797-f97906c943c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:54.798175 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94e4e2-e40c-47a8-8797-f97906c943c1 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:54.816798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7af1f69b86640d1b131a274eb79b4a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.824091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 663/1357] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:54.824998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94e4e2-e40c-47a8-8797-f97906c943c1 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:54.848644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1e94e4e2-e40c-47a8-8797-f97906c943c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:54.865452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7af1f69b86640d1b131a274eb79b4a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.866220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94e4e2-e40c-47a8-8797-f97906c943c1 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:54.868278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7af1f69b86640d1b131a274eb79b4a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.887848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a56dcb-ba6d-494f-85f3-37e22941b2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:54.888421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56dcb-ba6d-494f-85f3-37e22941b2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.888712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56dcb-ba6d-494f-85f3-37e22941b2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.888988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56dcb-ba6d-494f-85f3-37e22941b2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:54.907635 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a56dcb-ba6d-494f-85f3-37e22941b2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:54.909926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a56dcb-ba6d-494f-85f3-37e22941b2f7 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:54.923704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-988fbead-0080-4252-b425-3d56b228a250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7af1f69b86640d1b131a274eb79b4a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:54.938591 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 695/1358] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:23:54 2022] DELETE /identity/v3/users/a7af1f69b86640d1b131a274eb79b4a7 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:54.940258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139d28e-3040-447b-8b4f-838a6cab5f5c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.940643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139d28e-3040-447b-8b4f-838a6cab5f5c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.941019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139d28e-3040-447b-8b4f-838a6cab5f5c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:54.945482 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 664/1359] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:54.947206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 696/1360] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:23:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:54.948549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d736-17fb-4f73-b757-a5e3342e5e22 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.954031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d736-17fb-4f73-b757-a5e3342e5e22 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.954615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d736-17fb-4f73-b757-a5e3342e5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:54.968752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663d3b-ef2e-4dc9-8d72-1315523fcc79 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:54.969356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663d3b-ef2e-4dc9-8d72-1315523fcc79 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:54.969841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663d3b-ef2e-4dc9-8d72-1315523fcc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:55.000684 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cdd6d736-17fb-4f73-b757-a5e3342e5e22 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:55.012586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cdd6d736-17fb-4f73-b757-a5e3342e5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:55.020179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f4663d3b-ef2e-4dc9-8d72-1315523fcc79 None None] MFA Rules not processed for user `bc32363c074f4418964ea46068a28831`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:55.021508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f4663d3b-ef2e-4dc9-8d72-1315523fcc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:55.168471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 697/1361] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:55.215070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 665/1362] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:55.385530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d736-17fb-4f73-b757-a5e3342e5e22 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:55.387020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cdd6d736-17fb-4f73-b757-a5e3342e5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:55.389980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4663d3b-ef2e-4dc9-8d72-1315523fcc79 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:55.391417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f4663d3b-ef2e-4dc9-8d72-1315523fcc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:55.416337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4663d3b-ef2e-4dc9-8d72-1315523fcc79 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:55.429187 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f4ae8-3d3c-4832-9fa2-f1a40077b479 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:55.429848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f4ae8-3d3c-4832-9fa2-f1a40077b479 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:55.430167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f4ae8-3d3c-4832-9fa2-f1a40077b479 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:55.430405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f4ae8-3d3c-4832-9fa2-f1a40077b479 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:55.449191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f4ae8-3d3c-4832-9fa2-f1a40077b479 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:55.451492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f4ae8-3d3c-4832-9fa2-f1a40077b479 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:55.474866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 666/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:23:55.584937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d736-17fb-4f73-b757-a5e3342e5e22 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:55.597257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f782d-e348-4e2b-a8a5-2ae5e435700c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:55.598604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f782d-e348-4e2b-a8a5-2ae5e435700c service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:55.599140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f782d-e348-4e2b-a8a5-2ae5e435700c service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:55.601030 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f782d-e348-4e2b-a8a5-2ae5e435700c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:55.688621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f782d-e348-4e2b-a8a5-2ae5e435700c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:55.723163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f782d-e348-4e2b-a8a5-2ae5e435700c service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:55.793475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 698/1364] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:57.478316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f4ae8-3d3c-4832-9fa2-f1a40077b479 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:57.480794 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e81f4ae8-3d3c-4832-9fa2-f1a40077b479 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:57.510984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f4ae8-3d3c-4832-9fa2-f1a40077b479 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:57.525115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:57.525792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:57.526080 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:57.526519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] PATH_INFO: `/v3/projects/dc795c56c4ec476999855dd63de5ffc7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:57.531748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc795c56c4ec476999855dd63de5ffc7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:57.533923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:57.605026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f782d-e348-4e2b-a8a5-2ae5e435700c service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:57.607101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8f1f782d-e348-4e2b-a8a5-2ae5e435700c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:57.633553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f782d-e348-4e2b-a8a5-2ae5e435700c service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:57.643222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:57.669217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc795c56c4ec476999855dd63de5ffc7', 'request_id': 'req-2b8837a3-8fc8-4542-97f7-d4de6650a885'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.697828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc795c56c4ec476999855dd63de5ffc7', 'request_id': 'req-2b8837a3-8fc8-4542-97f7-d4de6650a885'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.706628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc795c56c4ec476999855dd63de5ffc7', 'request_id': 'req-2b8837a3-8fc8-4542-97f7-d4de6650a885'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.744492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] The token cache is being invalidate because project dc795c56c4ec476999855dd63de5ffc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:23:57.745128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.746939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b8837a3-8fc8-4542-97f7-d4de6650a885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.750320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 667/1365] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:23:57 2022] DELETE /identity/v3/projects/dc795c56c4ec476999855dd63de5ffc7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:57.755067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b876b0-1a6d-47e1-bcb0-7d6d98b9af05 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:57.755578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b876b0-1a6d-47e1-bcb0-7d6d98b9af05 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:57.757270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b876b0-1a6d-47e1-bcb0-7d6d98b9af05 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:57.758950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 668/1366] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:23:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:57.763681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b876b0-1a6d-47e1-bcb0-7d6d98b9af05 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:57.768896 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-42b876b0-1a6d-47e1-bcb0-7d6d98b9af05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:57.771485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:57.772421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:57.773183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:57.773183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] PATH_INFO: `/v3/projects/613c726cd46241c694df5152f52ff8cd` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:57.774472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=613c726cd46241c694df5152f52ff8cd)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:57.779397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:57.805584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b876b0-1a6d-47e1-bcb0-7d6d98b9af05 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:57.819051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:57.820002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:57.820469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:57.820887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] PATH_INFO: `/v3/users/c4eaebd7109e4898a54811c6a8e3dde1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:57.825310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4eaebd7109e4898a54811c6a8e3dde1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:57.827490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:57.896597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:57.897608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613c726cd46241c694df5152f52ff8cd', 'request_id': 'req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.915468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613c726cd46241c694df5152f52ff8cd', 'request_id': 'req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.934649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613c726cd46241c694df5152f52ff8cd', 'request_id': 'req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.969666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] The token cache is being invalidate because project 613c726cd46241c694df5152f52ff8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:23:57.970971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.972436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:57.976705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 699/1367] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:23:57 2022] DELETE /identity/v3/projects/613c726cd46241c694df5152f52ff8cd => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:57.980757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:57.982065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:57.982637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4eaebd7109e4898a54811c6a8e3dde1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.004795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4eaebd7109e4898a54811c6a8e3dde1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.023830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4eaebd7109e4898a54811c6a8e3dde1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.038300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4eaebd7109e4898a54811c6a8e3dde1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.039102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5c6944a6-ba1b-44c6-b57a-836ba163ad94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4eaebd7109e4898a54811c6a8e3dde1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.053641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 669/1368] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:23:57 2022] DELETE /identity/v3/users/c4eaebd7109e4898a54811c6a8e3dde1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:58.055484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56df6f3-27cb-458f-bc2f-0a44b2ea3da7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:58.055963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56df6f3-27cb-458f-bc2f-0a44b2ea3da7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:58.056313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56df6f3-27cb-458f-bc2f-0a44b2ea3da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:58.105172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b56df6f3-27cb-458f-bc2f-0a44b2ea3da7 None None] MFA Rules not processed for user `bc32363c074f4418964ea46068a28831`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:58.110700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b56df6f3-27cb-458f-bc2f-0a44b2ea3da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:58.134362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aac5d-0ca1-49be-8bc9-c9ab1f4490dc admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:58.228132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:58.234861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 670/1369] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:58.236837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643a999-448e-4285-b4aa-1c806eaff7cd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:58.238521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643a999-448e-4285-b4aa-1c806eaff7cd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:58.238994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643a999-448e-4285-b4aa-1c806eaff7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:58.260372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:58.261202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:58.261340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:58.261580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] PATH_INFO: `/v3/projects/5fe3225b2bc24f06b7969316d93ec141` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:58.264632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe3225b2bc24f06b7969316d93ec141)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:58.266606 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:58.274682 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9643a999-448e-4285-b4aa-1c806eaff7cd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:58.276076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9643a999-448e-4285-b4aa-1c806eaff7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:58.289397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 671/1370] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:58.290409 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643a999-448e-4285-b4aa-1c806eaff7cd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:58.300702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9643a999-448e-4285-b4aa-1c806eaff7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:58.333198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643a999-448e-4285-b4aa-1c806eaff7cd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:58.345669 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:58.347035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:58.347035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:58.347507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] PATH_INFO: `/v3/users/b61f3548f1254a289eba50b86071aae3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:58.351262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61f3548f1254a289eba50b86071aae3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:58.353441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:58.411987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe3225b2bc24f06b7969316d93ec141', 'request_id': 'req-832202af-2952-40e0-96d9-2263eeb6aff7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.434952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe3225b2bc24f06b7969316d93ec141', 'request_id': 'req-832202af-2952-40e0-96d9-2263eeb6aff7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.447036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe3225b2bc24f06b7969316d93ec141', 'request_id': 'req-832202af-2952-40e0-96d9-2263eeb6aff7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.462478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61f3548f1254a289eba50b86071aae3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.480398 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61f3548f1254a289eba50b86071aae3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.489705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] The token cache is being invalidate because project 5fe3225b2bc24f06b7969316d93ec141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:23:58.489953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.491368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.497010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 700/1371] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:23:57 2022] DELETE /identity/v3/projects/5fe3225b2bc24f06b7969316d93ec141 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:58.500972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:58.505423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:58.506977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61f3548f1254a289eba50b86071aae3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.518824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:58.533878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61f3548f1254a289eba50b86071aae3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.535064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88601695-34dc-4d4d-af31-8b86f5ba03a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61f3548f1254a289eba50b86071aae3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.543499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 672/1372] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:23:58 2022] DELETE /identity/v3/users/b61f3548f1254a289eba50b86071aae3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:58.548446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea09bae-67c9-47c7-b952-c55a3f50fc8c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:58.548958 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea09bae-67c9-47c7-b952-c55a3f50fc8c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:58.549502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea09bae-67c9-47c7-b952-c55a3f50fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:58.592351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-aea09bae-67c9-47c7-b952-c55a3f50fc8c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:58.597885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aea09bae-67c9-47c7-b952-c55a3f50fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:58.664908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832202af-2952-40e0-96d9-2263eeb6aff7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:58.729388 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 673/1373] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:58.730475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea09bae-67c9-47c7-b952-c55a3f50fc8c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:58.738871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aea09bae-67c9-47c7-b952-c55a3f50fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:58.764038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea09bae-67c9-47c7-b952-c55a3f50fc8c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:58.776042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:58.777042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:58.777530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:58.777892 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] PATH_INFO: `/v3/users/3ab1f4b9a8d749ef8a9cb7ee62061ff8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:58.779179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab1f4b9a8d749ef8a9cb7ee62061ff8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:58.781208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:58.819549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6626c-bd74-48a2-8124-8427a7aa6267 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:58.820110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6626c-bd74-48a2-8124-8427a7aa6267 service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:58.820713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6626c-bd74-48a2-8124-8427a7aa6267 service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:58.820713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6626c-bd74-48a2-8124-8427a7aa6267 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:58.826635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-49d6626c-bd74-48a2-8124-8427a7aa6267 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:58.862522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6626c-bd74-48a2-8124-8427a7aa6267 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:58.867876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6626c-bd74-48a2-8124-8427a7aa6267 service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:58.896905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 701/1374] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:58.899566 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6626c-bd74-48a2-8124-8427a7aa6267 service placement] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:58.926848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6626c-bd74-48a2-8124-8427a7aa6267 service placement] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:58.942912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e560c-164b-4aad-aa6f-c303c37b2a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:58.945664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e560c-164b-4aad-aa6f-c303c37b2a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:58.945953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e560c-164b-4aad-aa6f-c303c37b2a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:58.946226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e560c-164b-4aad-aa6f-c303c37b2a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:58.949403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e560c-164b-4aad-aa6f-c303c37b2a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:58.949727 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e560c-164b-4aad-aa6f-c303c37b2a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:58.954210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e560c-164b-4aad-aa6f-c303c37b2a05 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:58.957954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab1f4b9a8d749ef8a9cb7ee62061ff8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:58.959513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:58.987088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab1f4b9a8d749ef8a9cb7ee62061ff8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:59.000821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 702/1375] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:59.010304 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ee57-73b6-4efa-9c15-631f2488e5a9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:59.012080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ee57-73b6-4efa-9c15-631f2488e5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:59.012432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ee57-73b6-4efa-9c15-631f2488e5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:59.016335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab1f4b9a8d749ef8a9cb7ee62061ff8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:59.031169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab1f4b9a8d749ef8a9cb7ee62061ff8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:59.032058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab1f4b9a8d749ef8a9cb7ee62061ff8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:59.060926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 674/1376] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:23:58 2022] DELETE /identity/v3/users/3ab1f4b9a8d749ef8a9cb7ee62061ff8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:59.061318 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:59.074135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:59.088511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9739ee57-73b6-4efa-9c15-631f2488e5a9 None None] MFA Rules not processed for user `2e9eb6b2ff274a8e810c3785a295e741`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:59.089784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9739ee57-73b6-4efa-9c15-631f2488e5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:59.229939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 703/1377] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:59.230910 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c50cc-d0b5-4b9a-8401-99a90acdcf93 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:59.242002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd151b6-04ce-4b04-8854-7eb8300e440b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:59.242354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd151b6-04ce-4b04-8854-7eb8300e440b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:59.242541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd151b6-04ce-4b04-8854-7eb8300e440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:59.249024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d633de-90ee-437a-aee4-a5a3e95ba8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:59.251644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d633de-90ee-437a-aee4-a5a3e95ba8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:59.253096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d633de-90ee-437a-aee4-a5a3e95ba8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:59.253475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d633de-90ee-437a-aee4-a5a3e95ba8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:59.255238 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d633de-90ee-437a-aee4-a5a3e95ba8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:59.261520 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d633de-90ee-437a-aee4-a5a3e95ba8fa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:59.288983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:59.292367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2dd151b6-04ce-4b04-8854-7eb8300e440b None None] MFA Rules not processed for user `2e9eb6b2ff274a8e810c3785a295e741`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:59.294058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2dd151b6-04ce-4b04-8854-7eb8300e440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:59.320215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 704/1378] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:59.328758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd151b6-04ce-4b04-8854-7eb8300e440b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:59.334975 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2dd151b6-04ce-4b04-8854-7eb8300e440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:59.335625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 675/1379] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:23:59 2022] POST /identity/v3/projects => generated 365 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:59.336494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d633de-90ee-437a-aee4-a5a3e95ba8fa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:59.522141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d633de-90ee-437a-aee4-a5a3e95ba8fa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:59.535154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb7f76-7eee-465c-933f-a24b98587d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:59.535966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb7f76-7eee-465c-933f-a24b98587d29 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:59.538050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb7f76-7eee-465c-933f-a24b98587d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:59.538050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb7f76-7eee-465c-933f-a24b98587d29 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:59.540931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb7f76-7eee-465c-933f-a24b98587d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:59.543034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb7f76-7eee-465c-933f-a24b98587d29 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:59.549759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd151b6-04ce-4b04-8854-7eb8300e440b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:59.594725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 676/1380] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:23:59 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:59.595962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb7f76-7eee-465c-933f-a24b98587d29 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:59.601555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d1cb7f76-7eee-465c-933f-a24b98587d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:59.637459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb7f76-7eee-465c-933f-a24b98587d29 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:59.655096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:59.656640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:59.658096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:59.662149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] PATH_INFO: `/v3/projects/1fe364be20f74cc7892bd9b91f856312` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:59.667424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe364be20f74cc7892bd9b91f856312)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:59.677225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:59.805516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f1aa-62ec-4ea1-81e7-6f860ed66cc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:59.806443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f1aa-62ec-4ea1-81e7-6f860ed66cc3 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:59.807137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f1aa-62ec-4ea1-81e7-6f860ed66cc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:59.807137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f1aa-62ec-4ea1-81e7-6f860ed66cc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:59.872228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:59.981557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe364be20f74cc7892bd9b91f856312', 'request_id': 'req-6625486b-2840-4889-ab35-b7125161b392'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.016530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe364be20f74cc7892bd9b91f856312', 'request_id': 'req-6625486b-2840-4889-ab35-b7125161b392'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.029233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe364be20f74cc7892bd9b91f856312', 'request_id': 'req-6625486b-2840-4889-ab35-b7125161b392'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.032374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f1aa-62ec-4ea1-81e7-6f860ed66cc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:00.036365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f1aa-62ec-4ea1-81e7-6f860ed66cc3 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:00.055774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] The token cache is being invalidate because project 1fe364be20f74cc7892bd9b91f856312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:00.056420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.057408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.058311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 705/1381] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:23:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:00.059223 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f1aa-62ec-4ea1-81e7-6f860ed66cc3 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:00.060214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 677/1382] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:23:59 2022] DELETE /identity/v3/projects/1fe364be20f74cc7892bd9b91f856312 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:00.084492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:00.089215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:00.090955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f1aa-62ec-4ea1-81e7-6f860ed66cc3 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:00.215640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7163ae6-8b77-4d25-a2a2-4947be4730bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:00.216417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163ae6-8b77-4d25-a2a2-4947be4730bb admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:00.216727 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163ae6-8b77-4d25-a2a2-4947be4730bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:00.216839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163ae6-8b77-4d25-a2a2-4947be4730bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:00.217470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7163ae6-8b77-4d25-a2a2-4947be4730bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:00.222436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7163ae6-8b77-4d25-a2a2-4947be4730bb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:00.253528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 706/1383] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:00.261513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7163ae6-8b77-4d25-a2a2-4947be4730bb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:00.273060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b7163ae6-8b77-4d25-a2a2-4947be4730bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:00.289474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625486b-2840-4889-ab35-b7125161b392 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:00.294654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:00.295376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:00.296323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:00.296323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] PATH_INFO: `/v3/users/aac2814bfe6c4b40954b7908c99e9f31` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:00.297362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac2814bfe6c4b40954b7908c99e9f31)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:00.299488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:00.305195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:00.307669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7163ae6-8b77-4d25-a2a2-4947be4730bb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:00.331960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a42429-8715-4457-af02-c3313c28464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:00.332615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a42429-8715-4457-af02-c3313c28464f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:00.332903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a42429-8715-4457-af02-c3313c28464f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:00.333185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a42429-8715-4457-af02-c3313c28464f admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:00.333851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a42429-8715-4457-af02-c3313c28464f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:00.335521 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a42429-8715-4457-af02-c3313c28464f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:00.373300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 707/1384] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:00.380299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a42429-8715-4457-af02-c3313c28464f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:00.409127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a42429-8715-4457-af02-c3313c28464f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:00.411849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac2814bfe6c4b40954b7908c99e9f31'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.432842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac2814bfe6c4b40954b7908c99e9f31'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.433384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5953e1-60ce-4653-a226-cc1b229514d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:00.434091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5953e1-60ce-4653-a226-cc1b229514d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:00.434372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5953e1-60ce-4653-a226-cc1b229514d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:00.434660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5953e1-60ce-4653-a226-cc1b229514d1 admin admin] PATH_INFO: `/v3/projects/1c8e819470244f3481838fa025911301/users/bc698bef253f4f6e99918ecb5125c39c/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:00.455478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac2814bfe6c4b40954b7908c99e9f31'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.466280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac2814bfe6c4b40954b7908c99e9f31'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.467363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac2814bfe6c4b40954b7908c99e9f31'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:00.481888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 678/1385] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:00 2022] DELETE /identity/v3/users/aac2814bfe6c4b40954b7908c99e9f31 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:00.498526 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5953e1-60ce-4653-a226-cc1b229514d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8e819470244f3481838fa025911301, user_id=bc698bef253f4f6e99918ecb5125c39c, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:00.501977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5953e1-60ce-4653-a226-cc1b229514d1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:00.518619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:00.524186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:00.575895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 708/1386] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:00 2022] PUT /identity/v3/projects/1c8e819470244f3481838fa025911301/users/bc698bef253f4f6e99918ecb5125c39c/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:00.581180 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe3d8-52ee-425a-a346-96a11ae0b012 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:00.582520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe3d8-52ee-425a-a346-96a11ae0b012 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:00.583032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe3d8-52ee-425a-a346-96a11ae0b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:00.672579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fb7fe3d8-52ee-425a-a346-96a11ae0b012 None None] MFA Rules not processed for user `bc698bef253f4f6e99918ecb5125c39c`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:00.674639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fb7fe3d8-52ee-425a-a346-96a11ae0b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:00.736293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a273a1d-894c-4425-b246-cb3906d89c80 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:00.869059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 709/1387] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:00.879050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe3d8-52ee-425a-a346-96a11ae0b012 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:00.880678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fb7fe3d8-52ee-425a-a346-96a11ae0b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:00.889451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:00.906983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:00.908471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:00.908763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:00.909042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] PATH_INFO: `/v3/projects/22548950571c456fad04129a6c12f886` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:00.913571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=22548950571c456fad04129a6c12f886)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:00.916973 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:01.016400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:01.055781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe3d8-52ee-425a-a346-96a11ae0b012 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:01.061177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22548950571c456fad04129a6c12f886', 'request_id': 'req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:01.089536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22548950571c456fad04129a6c12f886', 'request_id': 'req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:01.115479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22548950571c456fad04129a6c12f886', 'request_id': 'req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:01.162494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] The token cache is being invalidate because project 22548950571c456fad04129a6c12f886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:01.167135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:01.169630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e3beb56-17ec-44ae-b57f-6addfa6db5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:01.176170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 679/1388] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:00 2022] DELETE /identity/v3/projects/22548950571c456fad04129a6c12f886 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:01.182486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b71e68-0389-4686-8865-26f8c677e335 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:01.182841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b71e68-0389-4686-8865-26f8c677e335 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:01.186075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b71e68-0389-4686-8865-26f8c677e335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:01.265243 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d2b71e68-0389-4686-8865-26f8c677e335 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:01.267617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2b71e68-0389-4686-8865-26f8c677e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:01.272913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8078036-f5c6-4634-bd09-b3c11686b367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:01.273626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8078036-f5c6-4634-bd09-b3c11686b367 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:01.273852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8078036-f5c6-4634-bd09-b3c11686b367 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:01.276434 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8078036-f5c6-4634-bd09-b3c11686b367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:01.281423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d8078036-f5c6-4634-bd09-b3c11686b367 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:01.481198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 680/1389] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:01.488789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a5173-3c28-4c2d-a20e-1d0fd533cab5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:01.489088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a5173-3c28-4c2d-a20e-1d0fd533cab5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:01.489375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a5173-3c28-4c2d-a20e-1d0fd533cab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:01.529956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8078036-f5c6-4634-bd09-b3c11686b367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:01.533501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8078036-f5c6-4634-bd09-b3c11686b367 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:01.566863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 710/1390] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:01.594309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-008a5173-3c28-4c2d-a20e-1d0fd533cab5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:01.599961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-008a5173-3c28-4c2d-a20e-1d0fd533cab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:01.628471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 681/1391] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:01.634122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8078036-f5c6-4634-bd09-b3c11686b367 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:01.652876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8078036-f5c6-4634-bd09-b3c11686b367 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:01.665753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b095-51ae-4768-8ed0-9cd502e2f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:01.667405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b095-51ae-4768-8ed0-9cd502e2f9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:01.667704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b095-51ae-4768-8ed0-9cd502e2f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:01.667980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b095-51ae-4768-8ed0-9cd502e2f9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:01.670841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248b095-51ae-4768-8ed0-9cd502e2f9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:01.671185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248b095-51ae-4768-8ed0-9cd502e2f9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:01.674638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248b095-51ae-4768-8ed0-9cd502e2f9e8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:01.709767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a5173-3c28-4c2d-a20e-1d0fd533cab5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:01.716569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 711/1392] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:01.721888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a5173-3c28-4c2d-a20e-1d0fd533cab5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:01.727666 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0473bcb-b67d-41e0-9e5d-c3c29045b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:01.728309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0473bcb-b67d-41e0-9e5d-c3c29045b560 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:01.728589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0473bcb-b67d-41e0-9e5d-c3c29045b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:01.728861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0473bcb-b67d-41e0-9e5d-c3c29045b560 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:01.729819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0473bcb-b67d-41e0-9e5d-c3c29045b560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:01.731800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0473bcb-b67d-41e0-9e5d-c3c29045b560 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:01.825937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b095-51ae-4768-8ed0-9cd502e2f9e8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:01.831012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 682/1393] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:01 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:01.854031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01ac0-a33a-4640-b22e-dcbd2a16dc25 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:01.854571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01ac0-a33a-4640-b22e-dcbd2a16dc25 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:01.855033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01ac0-a33a-4640-b22e-dcbd2a16dc25 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:01.857005 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 683/1394] 10.222.0.23 () {54 vars in 912 bytes} [Thu Oct 27 01:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:24:01.867111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d084474-9554-4b49-acb2-9c97b57656fe None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:01.867645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b095-51ae-4768-8ed0-9cd502e2f9e8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:01.867785 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d084474-9554-4b49-acb2-9c97b57656fe None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:01.868195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d084474-9554-4b49-acb2-9c97b57656fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:02.027683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4d084474-9554-4b49-acb2-9c97b57656fe None None] MFA Rules not processed for user `6ae71e9e597240ee88c6bd0754244aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:02.030375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4d084474-9554-4b49-acb2-9c97b57656fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:02.121547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4dbb-fdd6-42df-8ed8-584d5b011b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:02.122302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4dbb-fdd6-42df-8ed8-584d5b011b93 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:02.122500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4dbb-fdd6-42df-8ed8-584d5b011b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:02.127669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce4dbb-fdd6-42df-8ed8-584d5b011b93 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:02.130668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4dbb-fdd6-42df-8ed8-584d5b011b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:02.139571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce4dbb-fdd6-42df-8ed8-584d5b011b93 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:02.181512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:02.217567 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 712/1395] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:01 2022] POST /identity/v3/users => generated 294 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:02.218582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4dbb-fdd6-42df-8ed8-584d5b011b93 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:02.228582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0fce4dbb-fdd6-42df-8ed8-584d5b011b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:02.268513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 684/1396] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:02.271885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d084474-9554-4b49-acb2-9c97b57656fe None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:02.297682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce4dbb-fdd6-42df-8ed8-584d5b011b93 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:02.316695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:02.318608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:02.318932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:02.319212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] PATH_INFO: `/v3/projects/6b0600b2aeb14e12ae723cc5fec664de` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:02.319859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d084474-9554-4b49-acb2-9c97b57656fe None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:02.325603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0600b2aeb14e12ae723cc5fec664de)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:02.332156 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:02.338841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bfc11-cb52-4bbc-a339-d0d502f42e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:02.339654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bfc11-cb52-4bbc-a339-d0d502f42e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:02.339985 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bfc11-cb52-4bbc-a339-d0d502f42e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:02.340257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bfc11-cb52-4bbc-a339-d0d502f42e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:02.340947 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bfc11-cb52-4bbc-a339-d0d502f42e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:02.350516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bfc11-cb52-4bbc-a339-d0d502f42e3f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:02.402689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 685/1397] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:02.413324 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bfc11-cb52-4bbc-a339-d0d502f42e3f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:02.420352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3a4bfc11-cb52-4bbc-a339-d0d502f42e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:02.471926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bfc11-cb52-4bbc-a339-d0d502f42e3f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:02.513430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc030-db9b-4c69-b7d1-88fa414fb1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:02.513430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc030-db9b-4c69-b7d1-88fa414fb1ca service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:02.513430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc030-db9b-4c69-b7d1-88fa414fb1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:02.513430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc030-db9b-4c69-b7d1-88fa414fb1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:02.525464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0600b2aeb14e12ae723cc5fec664de', 'request_id': 'req-bc340d8b-b04b-41c2-b330-434e38c6f2d7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:02.528510 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dc030-db9b-4c69-b7d1-88fa414fb1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:02.533065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dc030-db9b-4c69-b7d1-88fa414fb1ca service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:02.550600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0600b2aeb14e12ae723cc5fec664de', 'request_id': 'req-bc340d8b-b04b-41c2-b330-434e38c6f2d7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:02.568281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 686/1398] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:02.569059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0600b2aeb14e12ae723cc5fec664de', 'request_id': 'req-bc340d8b-b04b-41c2-b330-434e38c6f2d7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:02.570652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc030-db9b-4c69-b7d1-88fa414fb1ca service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:02.587147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:02.597592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc030-db9b-4c69-b7d1-88fa414fb1ca service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:02.599445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] The token cache is being invalidate because project 6b0600b2aeb14e12ae723cc5fec664de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:02.600203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:02.601806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc340d8b-b04b-41c2-b330-434e38c6f2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:02.605599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 713/1399] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:02 2022] DELETE /identity/v3/projects/6b0600b2aeb14e12ae723cc5fec664de => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:02.620676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f426e1-cc26-4b69-b08d-549387f663aa None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:02.621010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f426e1-cc26-4b69-b08d-549387f663aa None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:02.623589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f426e1-cc26-4b69-b08d-549387f663aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:02.672792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-73f426e1-cc26-4b69-b08d-549387f663aa None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:02.675005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-73f426e1-cc26-4b69-b08d-549387f663aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:02.754310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63f1de-57d2-47d4-b368-0c36605ce657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:02.755011 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63f1de-57d2-47d4-b368-0c36605ce657 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:02.755298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63f1de-57d2-47d4-b368-0c36605ce657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:02.755579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63f1de-57d2-47d4-b368-0c36605ce657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:02.756310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63f1de-57d2-47d4-b368-0c36605ce657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:02.758312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63f1de-57d2-47d4-b368-0c36605ce657 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:02.789487 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 687/1400] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:02.789487 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63f1de-57d2-47d4-b368-0c36605ce657 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:02.796521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fa63f1de-57d2-47d4-b368-0c36605ce657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:02.826827 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63f1de-57d2-47d4-b368-0c36605ce657 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:02.836011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 714/1401] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:02.836902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f426e1-cc26-4b69-b08d-549387f663aa None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:02.839143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-73f426e1-cc26-4b69-b08d-549387f663aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:02.855108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:02.855795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:02.856082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:02.856358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] PATH_INFO: `/v3/projects/1d934e09483e4c29ae1069925f1ef812` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:02.861023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d934e09483e4c29ae1069925f1ef812)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:02.872879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:02.905088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f426e1-cc26-4b69-b08d-549387f663aa None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:02.916994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc42795-9628-4401-a577-1a309a04c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:02.919680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc42795-9628-4401-a577-1a309a04c5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:02.919680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc42795-9628-4401-a577-1a309a04c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:02.919680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc42795-9628-4401-a577-1a309a04c5e9 admin admin] PATH_INFO: `/v3/projects/c9e8dc4d4bd142e78f9fb30ddb0b9c6d/users/36b350ba89054d1198b1ec1ca8a8b248/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:02.995269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc42795-9628-4401-a577-1a309a04c5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e8dc4d4bd142e78f9fb30ddb0b9c6d, user_id=36b350ba89054d1198b1ec1ca8a8b248, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:02.999760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc42795-9628-4401-a577-1a309a04c5e9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:03.038819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 715/1402] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:02 2022] PUT /identity/v3/projects/c9e8dc4d4bd142e78f9fb30ddb0b9c6d/users/36b350ba89054d1198b1ec1ca8a8b248/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:03.040437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a9ae-0a64-4ce9-9a54-866ec2a0ab63 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:03.044209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a9ae-0a64-4ce9-9a54-866ec2a0ab63 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:03.044397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96a9ae-0a64-4ce9-9a54-866ec2a0ab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:03.063070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d934e09483e4c29ae1069925f1ef812', 'request_id': 'req-e7b27729-0d52-4f48-a44f-d8cf7460b095'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:03.086271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d934e09483e4c29ae1069925f1ef812', 'request_id': 'req-e7b27729-0d52-4f48-a44f-d8cf7460b095'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:03.096868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3a96a9ae-0a64-4ce9-9a54-866ec2a0ab63 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:03.098424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3a96a9ae-0a64-4ce9-9a54-866ec2a0ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:03.108813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d934e09483e4c29ae1069925f1ef812', 'request_id': 'req-e7b27729-0d52-4f48-a44f-d8cf7460b095'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:03.133587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] The token cache is being invalidate because project 1d934e09483e4c29ae1069925f1ef812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:03.133587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:03.134282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e7b27729-0d52-4f48-a44f-d8cf7460b095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:03.136231 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 688/1403] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:02 2022] DELETE /identity/v3/projects/1d934e09483e4c29ae1069925f1ef812 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:03.137827 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c090b2-b26b-4e91-bc64-f4e2686a5ad7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:03.138118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c090b2-b26b-4e91-bc64-f4e2686a5ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:03.138391 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c090b2-b26b-4e91-bc64-f4e2686a5ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:03.193586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:03.206005 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-56c090b2-b26b-4e91-bc64-f4e2686a5ad7 None None] MFA Rules not processed for user `16050dda2b5e42e2b245dfc5f4a43532`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:03.207365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-56c090b2-b26b-4e91-bc64-f4e2686a5ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:03.240674 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 716/1404] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:03.242028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a227b-0504-48d3-ba5f-5da2d3daab46 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:03.242342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a227b-0504-48d3-ba5f-5da2d3daab46 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:03.242608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a227b-0504-48d3-ba5f-5da2d3daab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:03.324586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9d5a227b-0504-48d3-ba5f-5da2d3daab46 None None] MFA Rules not processed for user `36b350ba89054d1198b1ec1ca8a8b248`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:03.325866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9d5a227b-0504-48d3-ba5f-5da2d3daab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:03.381298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 689/1405] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:03.382858 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5796ab-d38a-4c14-9566-95589e620b3d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:03.383151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5796ab-d38a-4c14-9566-95589e620b3d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:03.383427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5796ab-d38a-4c14-9566-95589e620b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:03.407222 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6a5796ab-d38a-4c14-9566-95589e620b3d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:03.408496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6a5796ab-d38a-4c14-9566-95589e620b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:03.423308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 690/1406] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:03.424442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5796ab-d38a-4c14-9566-95589e620b3d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:03.446924 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5796ab-d38a-4c14-9566-95589e620b3d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:03.463431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b868b0-7a09-4fbe-99ea-46d53dd12bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:03.464131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b868b0-7a09-4fbe-99ea-46d53dd12bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:03.464348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b868b0-7a09-4fbe-99ea-46d53dd12bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:03.467293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b868b0-7a09-4fbe-99ea-46d53dd12bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:03.472335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b868b0-7a09-4fbe-99ea-46d53dd12bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:03.473532 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b868b0-7a09-4fbe-99ea-46d53dd12bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:03.477622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b868b0-7a09-4fbe-99ea-46d53dd12bc2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:03.488818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:03.508937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 691/1407] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:03.514126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28085680-e69c-4ac7-9b20-bb0ad55ab0e2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:03.521736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28085680-e69c-4ac7-9b20-bb0ad55ab0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:03.521736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28085680-e69c-4ac7-9b20-bb0ad55ab0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:03.528137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 717/1408] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:03.529519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d9a3e-e13e-4980-8179-763934e99328 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:03.529800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d9a3e-e13e-4980-8179-763934e99328 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:03.530077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d9a3e-e13e-4980-8179-763934e99328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:03.569760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-674d9a3e-e13e-4980-8179-763934e99328 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:03.572008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-674d9a3e-e13e-4980-8179-763934e99328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:03.584920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 718/1409] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:03.585505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-28085680-e69c-4ac7-9b20-bb0ad55ab0e2 None None] MFA Rules not processed for user `16050dda2b5e42e2b245dfc5f4a43532`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:03.585789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d9a3e-e13e-4980-8179-763934e99328 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:03.588468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-28085680-e69c-4ac7-9b20-bb0ad55ab0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:03.599025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d9a3e-e13e-4980-8179-763934e99328 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:03.611399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf06aa-7164-45cb-b36e-14a726fb3260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:03.612389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf06aa-7164-45cb-b36e-14a726fb3260 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:03.612908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf06aa-7164-45cb-b36e-14a726fb3260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:03.613543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf06aa-7164-45cb-b36e-14a726fb3260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:03.614665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf06aa-7164-45cb-b36e-14a726fb3260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:03.617018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf06aa-7164-45cb-b36e-14a726fb3260 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:03.625008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 692/1410] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:03.628245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28085680-e69c-4ac7-9b20-bb0ad55ab0e2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:03.634125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-28085680-e69c-4ac7-9b20-bb0ad55ab0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:03.693614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28085680-e69c-4ac7-9b20-bb0ad55ab0e2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:03.706972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559be2b3-dfc1-43aa-8b6d-badd4a89fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:03.707278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 719/1411] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:03 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:03.709068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf06aa-7164-45cb-b36e-14a726fb3260 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:03.718908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559be2b3-dfc1-43aa-8b6d-badd4a89fae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:03.718908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559be2b3-dfc1-43aa-8b6d-badd4a89fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:03.719137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559be2b3-dfc1-43aa-8b6d-badd4a89fae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:03.719736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559be2b3-dfc1-43aa-8b6d-badd4a89fae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:03.744647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559be2b3-dfc1-43aa-8b6d-badd4a89fae7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:03.854423 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 693/1412] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:03 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:03.857455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559be2b3-dfc1-43aa-8b6d-badd4a89fae7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:03.863563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-559be2b3-dfc1-43aa-8b6d-badd4a89fae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:03.971733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf06aa-7164-45cb-b36e-14a726fb3260 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.064909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559be2b3-dfc1-43aa-8b6d-badd4a89fae7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.074176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c91cc-6461-49e3-96f3-08580ef768b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.075098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c91cc-6461-49e3-96f3-08580ef768b0 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.075543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c91cc-6461-49e3-96f3-08580ef768b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.075833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:04.076152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c91cc-6461-49e3-96f3-08580ef768b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.121433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35227eb8-2f83-4ceb-a1f1-075010a1735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.121982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35227eb8-2f83-4ceb-a1f1-075010a1735b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.122267 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35227eb8-2f83-4ceb-a1f1-075010a1735b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.122540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35227eb8-2f83-4ceb-a1f1-075010a1735b admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.123289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35227eb8-2f83-4ceb-a1f1-075010a1735b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:04.127213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35227eb8-2f83-4ceb-a1f1-075010a1735b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.138876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35227eb8-2f83-4ceb-a1f1-075010a1735b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.193893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c91cc-6461-49e3-96f3-08580ef768b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.194296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 720/1413] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:04.195256 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35227eb8-2f83-4ceb-a1f1-075010a1735b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:04.196720 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c91cc-6461-49e3-96f3-08580ef768b0 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.208359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 694/1414] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:04.209444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c91cc-6461-49e3-96f3-08580ef768b0 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:04.221479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35227eb8-2f83-4ceb-a1f1-075010a1735b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.221977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c91cc-6461-49e3-96f3-08580ef768b0 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.227083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88c3d-ba37-4379-893b-46fc672b58b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.228042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88c3d-ba37-4379-893b-46fc672b58b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.228462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88c3d-ba37-4379-893b-46fc672b58b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.228808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88c3d-ba37-4379-893b-46fc672b58b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.229602 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88c3d-ba37-4379-893b-46fc672b58b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.231712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88c3d-ba37-4379-893b-46fc672b58b0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.235013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a889e7b-7ca6-40e3-a790-f2ea695f4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.235750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a889e7b-7ca6-40e3-a790-f2ea695f4140 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.236299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a889e7b-7ca6-40e3-a790-f2ea695f4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.236481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a889e7b-7ca6-40e3-a790-f2ea695f4140 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.239697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a889e7b-7ca6-40e3-a790-f2ea695f4140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.242328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a889e7b-7ca6-40e3-a790-f2ea695f4140 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.289515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 695/1415] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:04 2022] POST /identity/v3/users => generated 299 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:04.291534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88c3d-ba37-4379-893b-46fc672b58b0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:04.292798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 721/1416] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:04 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:04.295916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2ae88c3d-ba37-4379-893b-46fc672b58b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:04.297200 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29dbb-88cd-4c92-a0d3-fbd8844902e1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.297488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29dbb-88cd-4c92-a0d3-fbd8844902e1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.297793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29dbb-88cd-4c92-a0d3-fbd8844902e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.342897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cad29dbb-88cd-4c92-a0d3-fbd8844902e1 None None] MFA Rules not processed for user `2e9eb6b2ff274a8e810c3785a295e741`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:04.344828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cad29dbb-88cd-4c92-a0d3-fbd8844902e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:04.393822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:04.447301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88c3d-ba37-4379-893b-46fc672b58b0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.464986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 722/1417] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:04.465999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256139d-f16c-4012-9bd7-cd3d1a1fa24c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.467328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256139d-f16c-4012-9bd7-cd3d1a1fa24c service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.467979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29dbb-88cd-4c92-a0d3-fbd8844902e1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:04.468336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256139d-f16c-4012-9bd7-cd3d1a1fa24c service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.470275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256139d-f16c-4012-9bd7-cd3d1a1fa24c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.477502 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a256139d-f16c-4012-9bd7-cd3d1a1fa24c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:04.501502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29dbb-88cd-4c92-a0d3-fbd8844902e1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.512813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256139d-f16c-4012-9bd7-cd3d1a1fa24c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.514442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d6331-6d28-4283-80e5-278e819329ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.515206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d6331-6d28-4283-80e5-278e819329ed admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.515485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d6331-6d28-4283-80e5-278e819329ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.515749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d6331-6d28-4283-80e5-278e819329ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.518131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256139d-f16c-4012-9bd7-cd3d1a1fa24c service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.521992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d6331-6d28-4283-80e5-278e819329ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.525020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d6331-6d28-4283-80e5-278e819329ed admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.547775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 696/1418] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:04.549414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256139d-f16c-4012-9bd7-cd3d1a1fa24c service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:04.577285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256139d-f16c-4012-9bd7-cd3d1a1fa24c service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.582830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c8e5-009d-4d66-afd2-9ff80d34cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.587904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c8e5-009d-4d66-afd2-9ff80d34cbac admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.589010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c8e5-009d-4d66-afd2-9ff80d34cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.589287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c8e5-009d-4d66-afd2-9ff80d34cbac admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.589996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58c8e5-009d-4d66-afd2-9ff80d34cbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.591594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58c8e5-009d-4d66-afd2-9ff80d34cbac admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.596905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 723/1419] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:04 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:04.597610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d6331-6d28-4283-80e5-278e819329ed admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:04.625777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 697/1420] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:04.628579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c8e5-009d-4d66-afd2-9ff80d34cbac admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:04.659017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c8e5-009d-4d66-afd2-9ff80d34cbac admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.748896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d6331-6d28-4283-80e5-278e819329ed admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.763584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155589d-3a14-4344-b841-0ad50cc73642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.764294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155589d-3a14-4344-b841-0ad50cc73642 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.764633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155589d-3a14-4344-b841-0ad50cc73642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.764942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155589d-3a14-4344-b841-0ad50cc73642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.766943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155589d-3a14-4344-b841-0ad50cc73642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.771653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155589d-3a14-4344-b841-0ad50cc73642 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.807778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 724/1421] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:04.809447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155589d-3a14-4344-b841-0ad50cc73642 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:04.847459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155589d-3a14-4344-b841-0ad50cc73642 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:04.859780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30978b-b5e5-4970-8260-d3e33d435478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.861541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30978b-b5e5-4970-8260-d3e33d435478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.862466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30978b-b5e5-4970-8260-d3e33d435478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.862574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30978b-b5e5-4970-8260-d3e33d435478 admin admin] PATH_INFO: `/v3/projects/0c6e56448ad14688a37b07b54aa52c84/users/2a76b26191564da9857e9f6bcdcf31aa/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.883501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca944-dd78-4647-857e-444cc048d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:04.884745 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca944-dd78-4647-857e-444cc048d177 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.885211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca944-dd78-4647-857e-444cc048d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.885712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca944-dd78-4647-857e-444cc048d177 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.886591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ca944-dd78-4647-857e-444cc048d177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.895302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ca944-dd78-4647-857e-444cc048d177 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.908821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30978b-b5e5-4970-8260-d3e33d435478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6e56448ad14688a37b07b54aa52c84, user_id=2a76b26191564da9857e9f6bcdcf31aa, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:04.913447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30978b-b5e5-4970-8260-d3e33d435478 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:04.940917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 725/1422] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:04 2022] PUT /identity/v3/projects/0c6e56448ad14688a37b07b54aa52c84/users/2a76b26191564da9857e9f6bcdcf31aa/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:04.943105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1abd-d410-473d-a163-be6eae58a518 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:04.945514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1abd-d410-473d-a163-be6eae58a518 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:04.946544 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1abd-d410-473d-a163-be6eae58a518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:04.953807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 698/1423] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:04 2022] POST /identity/v3/users => generated 297 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:04.958667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca944-dd78-4647-857e-444cc048d177 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:04.988287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca944-dd78-4647-857e-444cc048d177 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:05.018248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b17f1abd-d410-473d-a163-be6eae58a518 None None] MFA Rules not processed for user `563728f1570c48c3b79bf36e32681a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:05.019853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b17f1abd-d410-473d-a163-be6eae58a518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:05.063236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:05.123799 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f607881-f557-4d5e-a678-d21641a3fb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:05.127601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f607881-f557-4d5e-a678-d21641a3fb3d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.129150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f607881-f557-4d5e-a678-d21641a3fb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.129449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f607881-f557-4d5e-a678-d21641a3fb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.131531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f607881-f557-4d5e-a678-d21641a3fb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:05.135845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f607881-f557-4d5e-a678-d21641a3fb3d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:05.174105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 699/1424] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:05.178797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bb347-c582-4384-8a45-d377217c0d81 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.179097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bb347-c582-4384-8a45-d377217c0d81 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.179377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bb347-c582-4384-8a45-d377217c0d81 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.199287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 726/1425] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:05.199287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1abd-d410-473d-a163-be6eae58a518 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:05.199669 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 700/1426] 10.222.0.23 () {54 vars in 912 bytes} [Thu Oct 27 01:24:05 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:24:05.199669 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bb347-c582-4384-8a45-d377217c0d81 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:05.205293 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1abd-d410-473d-a163-be6eae58a518 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:05.211929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454296de-053f-4282-a18d-0fff35360c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:05.213067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454296de-053f-4282-a18d-0fff35360c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.213456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454296de-053f-4282-a18d-0fff35360c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.213883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454296de-053f-4282-a18d-0fff35360c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.214642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454296de-053f-4282-a18d-0fff35360c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:05.216781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454296de-053f-4282-a18d-0fff35360c7f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:05.233430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bb347-c582-4384-8a45-d377217c0d81 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:05.240520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 727/1427] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:05.242485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454296de-053f-4282-a18d-0fff35360c7f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:05.247451 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727d877-9674-4354-89b7-c830c55472ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:05.248109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d877-9674-4354-89b7-c830c55472ff admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.249828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d877-9674-4354-89b7-c830c55472ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.250113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d877-9674-4354-89b7-c830c55472ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.252803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727d877-9674-4354-89b7-c830c55472ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:05.254464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727d877-9674-4354-89b7-c830c55472ff admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:05.275553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454296de-053f-4282-a18d-0fff35360c7f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:05.289266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 701/1428] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:05.291162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4d269-854e-494e-ae3a-dadcb7c742f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:05.291856 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4d269-854e-494e-ae3a-dadcb7c742f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.292657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4d269-854e-494e-ae3a-dadcb7c742f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.292947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4d269-854e-494e-ae3a-dadcb7c742f9 admin admin] PATH_INFO: `/v3/projects/525f6df8e94e484ca6f5a757492e93a2/users/e58b039acd3d4148a6d637c72df5b759/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.294153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d028ba-9baa-4f4e-ac58-e5f91f37505f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.294453 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d028ba-9baa-4f4e-ac58-e5f91f37505f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.295076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d028ba-9baa-4f4e-ac58-e5f91f37505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.344029 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c7d028ba-9baa-4f4e-ac58-e5f91f37505f None None] MFA Rules not processed for user `6ae71e9e597240ee88c6bd0754244aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:05.345525 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c7d028ba-9baa-4f4e-ac58-e5f91f37505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:05.347591 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4d269-854e-494e-ae3a-dadcb7c742f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525f6df8e94e484ca6f5a757492e93a2, user_id=e58b039acd3d4148a6d637c72df5b759, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:05.357715 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4d269-854e-494e-ae3a-dadcb7c742f9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:05.395998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 728/1429] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:05 2022] PUT /identity/v3/projects/525f6df8e94e484ca6f5a757492e93a2/users/e58b039acd3d4148a6d637c72df5b759/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:05.398325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4d269-854e-494e-ae3a-dadcb7c742f9 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:05.433400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:05.502289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 702/1430] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:05.505471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d028ba-9baa-4f4e-ac58-e5f91f37505f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:05.554018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d028ba-9baa-4f4e-ac58-e5f91f37505f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:05.627791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4d269-854e-494e-ae3a-dadcb7c742f9 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:05.646682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca4d5f-26e8-4226-bcfe-cc0c3f5f3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:05.647464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca4d5f-26e8-4226-bcfe-cc0c3f5f3d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.648570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca4d5f-26e8-4226-bcfe-cc0c3f5f3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.649969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca4d5f-26e8-4226-bcfe-cc0c3f5f3d55 admin admin] PATH_INFO: `/v3/projects/0c6e56448ad14688a37b07b54aa52c84/users/2a76b26191564da9857e9f6bcdcf31aa/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.656298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca4d5f-26e8-4226-bcfe-cc0c3f5f3d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6e56448ad14688a37b07b54aa52c84, user_id=2a76b26191564da9857e9f6bcdcf31aa, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:05.663562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca4d5f-26e8-4226-bcfe-cc0c3f5f3d55 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:05.710028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 729/1431] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:05 2022] PUT /identity/v3/projects/0c6e56448ad14688a37b07b54aa52c84/users/2a76b26191564da9857e9f6bcdcf31aa/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:05.716174 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1c5f-4ec1-4152-86c1-58a0a1bd4364 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.716343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1c5f-4ec1-4152-86c1-58a0a1bd4364 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.716788 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1c5f-4ec1-4152-86c1-58a0a1bd4364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.770742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77547c67-58f4-4934-bc02-c1a3c1840c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:05.773223 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77547c67-58f4-4934-bc02-c1a3c1840c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.773561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77547c67-58f4-4934-bc02-c1a3c1840c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.775032 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77547c67-58f4-4934-bc02-c1a3c1840c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.778343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77547c67-58f4-4934-bc02-c1a3c1840c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:05.785380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77547c67-58f4-4934-bc02-c1a3c1840c48 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:05.820912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 703/1432] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:05.823277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77547c67-58f4-4934-bc02-c1a3c1840c48 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:05.827682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d23f1c5f-4ec1-4152-86c1-58a0a1bd4364 None None] MFA Rules not processed for user `e58b039acd3d4148a6d637c72df5b759`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:05.828936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d23f1c5f-4ec1-4152-86c1-58a0a1bd4364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:05.830033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-77547c67-58f4-4934-bc02-c1a3c1840c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:06.013066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77547c67-58f4-4934-bc02-c1a3c1840c48 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:06.055460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 730/1433] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:06.055460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45312943-6424-4fc9-911c-8267719ebe69 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:06.055460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45312943-6424-4fc9-911c-8267719ebe69 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:06.055460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45312943-6424-4fc9-911c-8267719ebe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:06.071475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:06.108519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-45312943-6424-4fc9-911c-8267719ebe69 None None] MFA Rules not processed for user `2a76b26191564da9857e9f6bcdcf31aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:06.112459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-45312943-6424-4fc9-911c-8267719ebe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:06.123942 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf21c8-a5d5-453f-90d1-5745d8e955bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:06.124950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf21c8-a5d5-453f-90d1-5745d8e955bd service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:06.125618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf21c8-a5d5-453f-90d1-5745d8e955bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:06.125901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf21c8-a5d5-453f-90d1-5745d8e955bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:06.145195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf21c8-a5d5-453f-90d1-5745d8e955bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:06.148250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf21c8-a5d5-453f-90d1-5745d8e955bd service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:06.167515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 704/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:06.185595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf21c8-a5d5-453f-90d1-5745d8e955bd service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:06.373215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:06.387750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 731/1435] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:06.387750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45312943-6424-4fc9-911c-8267719ebe69 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:06.435768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf21c8-a5d5-453f-90d1-5745d8e955bd service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:06.447435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcd6e9-e873-47b6-bcb9-10b37ce87fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:06.449337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcd6e9-e873-47b6-bcb9-10b37ce87fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:06.450336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcd6e9-e873-47b6-bcb9-10b37ce87fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:06.451023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcd6e9-e873-47b6-bcb9-10b37ce87fb6 admin admin] PATH_INFO: `/v3/projects/df47985955e94d4c9f47dd7c29151bf4/users/e35033c499054caba3af9aeb99c3d4eb/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:06.485862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcd6e9-e873-47b6-bcb9-10b37ce87fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df47985955e94d4c9f47dd7c29151bf4, user_id=e35033c499054caba3af9aeb99c3d4eb, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:06.493739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcd6e9-e873-47b6-bcb9-10b37ce87fb6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:06.533197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 705/1436] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:06 2022] PUT /identity/v3/projects/df47985955e94d4c9f47dd7c29151bf4/users/e35033c499054caba3af9aeb99c3d4eb/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:06.534921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcd6e9-e873-47b6-bcb9-10b37ce87fb6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:06.546641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9ffcd6e9-e873-47b6-bcb9-10b37ce87fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:06.599746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45312943-6424-4fc9-911c-8267719ebe69 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:06.773413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ee800-054f-450d-9b50-55f61e9635f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:06.780882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ee800-054f-450d-9b50-55f61e9635f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:06.781506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ee800-054f-450d-9b50-55f61e9635f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:06.782009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ee800-054f-450d-9b50-55f61e9635f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:06.783588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ee800-054f-450d-9b50-55f61e9635f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:06.784716 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcd6e9-e873-47b6-bcb9-10b37ce87fb6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:06.787386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ee800-054f-450d-9b50-55f61e9635f8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:06.813442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3147e03-d4e5-4160-8ae8-aa9652ee4837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:06.814103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3147e03-d4e5-4160-8ae8-aa9652ee4837 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:06.814466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3147e03-d4e5-4160-8ae8-aa9652ee4837 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:06.820249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3147e03-d4e5-4160-8ae8-aa9652ee4837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:06.887589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 732/1437] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:06 2022] POST /identity/v3/projects => generated 381 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:06.890516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e964-387d-45f2-93da-cca8d4c46f68 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:06.892084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e964-387d-45f2-93da-cca8d4c46f68 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:06.892997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e964-387d-45f2-93da-cca8d4c46f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:06.916960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3147e03-d4e5-4160-8ae8-aa9652ee4837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:06.918695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3147e03-d4e5-4160-8ae8-aa9652ee4837 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:06.930920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 706/1438] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:06.931881 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3147e03-d4e5-4160-8ae8-aa9652ee4837 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:06.933233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b3147e03-d4e5-4160-8ae8-aa9652ee4837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:07.011144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ef39e964-387d-45f2-93da-cca8d4c46f68 None None] MFA Rules not processed for user `c37589330ceb4193a7a504600b4ced84`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:07.012739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ef39e964-387d-45f2-93da-cca8d4c46f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:07.032454 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3147e03-d4e5-4160-8ae8-aa9652ee4837 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:07.047352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:07.075045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:07.148545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06b898-6ab1-4615-93f8-53d87e8c5803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:07.148929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06b898-6ab1-4615-93f8-53d87e8c5803 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:07.149234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06b898-6ab1-4615-93f8-53d87e8c5803 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:07.149507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06b898-6ab1-4615-93f8-53d87e8c5803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:07.218157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 733/1439] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:07.220764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da15b0-fed4-4bba-9924-d8dd3270b0f0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:07.220890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da15b0-fed4-4bba-9924-d8dd3270b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:07.221166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da15b0-fed4-4bba-9924-d8dd3270b0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:07.342386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-08da15b0-fed4-4bba-9924-d8dd3270b0f0 None None] MFA Rules not processed for user `e35033c499054caba3af9aeb99c3d4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:07.343647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-08da15b0-fed4-4bba-9924-d8dd3270b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:07.364767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06b898-6ab1-4615-93f8-53d87e8c5803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:07.373397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06b898-6ab1-4615-93f8-53d87e8c5803 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:07.424386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 707/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:07.429185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06b898-6ab1-4615-93f8-53d87e8c5803 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:07.536099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 734/1441] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:07.536099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da15b0-fed4-4bba-9924-d8dd3270b0f0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:07.631432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06b898-6ab1-4615-93f8-53d87e8c5803 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:07.645825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d035414-2971-4c09-ba9a-f010f6582739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:07.646903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d035414-2971-4c09-ba9a-f010f6582739 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:07.647397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d035414-2971-4c09-ba9a-f010f6582739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:07.648919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d035414-2971-4c09-ba9a-f010f6582739 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:07.650265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d035414-2971-4c09-ba9a-f010f6582739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:07.655458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d035414-2971-4c09-ba9a-f010f6582739 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:07.659429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da15b0-fed4-4bba-9924-d8dd3270b0f0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:07.664514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:07.665440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:07.665722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:07.666007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] PATH_INFO: `/v3/users/36b350ba89054d1198b1ec1ca8a8b248` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:07.667956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b350ba89054d1198b1ec1ca8a8b248)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:07.669893 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:07.783691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 708/1442] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:07 2022] POST /identity/v3/users => generated 297 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:07.784804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d035414-2971-4c09-ba9a-f010f6582739 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:07.808734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:07.816787 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b350ba89054d1198b1ec1ca8a8b248'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:07.864846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b350ba89054d1198b1ec1ca8a8b248'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:07.899440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b350ba89054d1198b1ec1ca8a8b248'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:07.901911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b350ba89054d1198b1ec1ca8a8b248'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:07.959178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b350ba89054d1198b1ec1ca8a8b248'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:07.990663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 735/1443] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:07 2022] DELETE /identity/v3/users/36b350ba89054d1198b1ec1ca8a8b248 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:07.991860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:07.993476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:08.009050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:08.058193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d035414-2971-4c09-ba9a-f010f6582739 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:08.306300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:08.307265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:08.307707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:08.308129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:08.310136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:08.377298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00049c5-57f1-4c17-9571-e218be81839c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:08.415914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1786b-ea49-4851-ad3a-6e002dac9786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:08.416828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1786b-ea49-4851-ad3a-6e002dac9786 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:08.416930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1786b-ea49-4851-ad3a-6e002dac9786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:08.417165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1786b-ea49-4851-ad3a-6e002dac9786 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:08.426743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1786b-ea49-4851-ad3a-6e002dac9786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:08.441898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1786b-ea49-4851-ad3a-6e002dac9786 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:08.452919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:08.460561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:08.492746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 709/1444] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:08.495267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:08.499500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:08.541630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dd98f-79f4-4b98-9c81-164ad6f8d4b6 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:08.565832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac261-150b-4743-8c7c-4fd63b7ea490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:08.568485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac261-150b-4743-8c7c-4fd63b7ea490 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:08.568810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac261-150b-4743-8c7c-4fd63b7ea490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:08.569986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac261-150b-4743-8c7c-4fd63b7ea490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:08.572571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedac261-150b-4743-8c7c-4fd63b7ea490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:08.582102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedac261-150b-4743-8c7c-4fd63b7ea490 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:08.602608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 736/1445] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:07 2022] POST /identity/v3/projects => generated 393 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:08.606049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d9479-ac76-493d-b81e-ae0bcc62c5af None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:08.607794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d9479-ac76-493d-b81e-ae0bcc62c5af None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:08.609207 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d9479-ac76-493d-b81e-ae0bcc62c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:08.621444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 710/1446] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:08.622379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac261-150b-4743-8c7c-4fd63b7ea490 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:08.638257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-bc6d9479-ac76-493d-b81e-ae0bcc62c5af None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:08.639646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bc6d9479-ac76-493d-b81e-ae0bcc62c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:08.649778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac261-150b-4743-8c7c-4fd63b7ea490 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:08.858949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 737/1447] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:08.860980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d9479-ac76-493d-b81e-ae0bcc62c5af None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:08.898672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d9479-ac76-493d-b81e-ae0bcc62c5af None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:08.911998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd35275-a8b1-4b05-80d8-6ca584b4e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:08.912733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd35275-a8b1-4b05-80d8-6ca584b4e969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:08.914264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd35275-a8b1-4b05-80d8-6ca584b4e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:08.914563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd35275-a8b1-4b05-80d8-6ca584b4e969 admin admin] PATH_INFO: `/v3/projects/4dc631237ed24a3ab7df33824140f915/users/bbf409781e2a4c38b693034beadb68cb/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:08.931318 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc501e2-2aa2-48b5-8c96-2bf13cd95f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:08.932435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc501e2-2aa2-48b5-8c96-2bf13cd95f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:08.932861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc501e2-2aa2-48b5-8c96-2bf13cd95f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:08.933299 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc501e2-2aa2-48b5-8c96-2bf13cd95f4e admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:08.934766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc501e2-2aa2-48b5-8c96-2bf13cd95f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:08.942236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc501e2-2aa2-48b5-8c96-2bf13cd95f4e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:08.997906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd35275-a8b1-4b05-80d8-6ca584b4e969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc631237ed24a3ab7df33824140f915, user_id=bbf409781e2a4c38b693034beadb68cb, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:09.011404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd35275-a8b1-4b05-80d8-6ca584b4e969 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:09.031505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 711/1448] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:08 2022] POST /identity/v3/users => generated 303 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:09.031505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843624b-c29a-45cf-ae99-fd8436df3509 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:09.031505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843624b-c29a-45cf-ae99-fd8436df3509 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:09.031505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843624b-c29a-45cf-ae99-fd8436df3509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:09.066123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 738/1449] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:08 2022] PUT /identity/v3/projects/4dc631237ed24a3ab7df33824140f915/users/bbf409781e2a4c38b693034beadb68cb/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:09.071147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd35275-a8b1-4b05-80d8-6ca584b4e969 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:09.075344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ebd35275-a8b1-4b05-80d8-6ca584b4e969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:09.122559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:09.207609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:09.266656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8843624b-c29a-45cf-ae99-fd8436df3509 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:09.269893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8843624b-c29a-45cf-ae99-fd8436df3509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:09.322067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd35275-a8b1-4b05-80d8-6ca584b4e969 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:09.332218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6846913-55af-4c5d-ab71-dca5a961189c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:09.333000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6846913-55af-4c5d-ab71-dca5a961189c service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:09.333345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6846913-55af-4c5d-ab71-dca5a961189c service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:09.333688 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6846913-55af-4c5d-ab71-dca5a961189c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:09.491208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 712/1450] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:09.494167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843624b-c29a-45cf-ae99-fd8436df3509 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:09.548219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6846913-55af-4c5d-ab71-dca5a961189c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:09.549744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6846913-55af-4c5d-ab71-dca5a961189c service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:09.568125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 739/1451] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:09.570069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6846913-55af-4c5d-ab71-dca5a961189c service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:09.587889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6846913-55af-4c5d-ab71-dca5a961189c service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:09.594475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43297804-71b8-48b2-961e-19687c4b4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:09.595698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43297804-71b8-48b2-961e-19687c4b4dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:09.598641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43297804-71b8-48b2-961e-19687c4b4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:09.599141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43297804-71b8-48b2-961e-19687c4b4dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:09.600673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43297804-71b8-48b2-961e-19687c4b4dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:09.603943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43297804-71b8-48b2-961e-19687c4b4dc9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:09.646752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 740/1452] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:09.654337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43297804-71b8-48b2-961e-19687c4b4dc9 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:09.674328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843624b-c29a-45cf-ae99-fd8436df3509 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:09.683076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff39f7-5f6d-4284-aa63-c44896eb48cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:09.683833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff39f7-5f6d-4284-aa63-c44896eb48cd admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:09.684120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff39f7-5f6d-4284-aa63-c44896eb48cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:09.684449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff39f7-5f6d-4284-aa63-c44896eb48cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:09.685114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff39f7-5f6d-4284-aa63-c44896eb48cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:09.686983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff39f7-5f6d-4284-aa63-c44896eb48cd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:09.706281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43297804-71b8-48b2-961e-19687c4b4dc9 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:09.731326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 713/1453] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:09.731718 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63099a64-e093-483b-8b17-346082b10b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:09.732788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff39f7-5f6d-4284-aa63-c44896eb48cd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:09.733360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63099a64-e093-483b-8b17-346082b10b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:09.735451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63099a64-e093-483b-8b17-346082b10b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:09.737254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63099a64-e093-483b-8b17-346082b10b5a admin admin] PATH_INFO: `/v3/projects/4dc631237ed24a3ab7df33824140f915/users/bbf409781e2a4c38b693034beadb68cb/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:09.745823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63099a64-e093-483b-8b17-346082b10b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc631237ed24a3ab7df33824140f915, user_id=bbf409781e2a4c38b693034beadb68cb, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:09.762864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63099a64-e093-483b-8b17-346082b10b5a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:09.776815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff39f7-5f6d-4284-aa63-c44896eb48cd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:09.798386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cf914-dbd4-4378-bcc1-ec213ca8c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:09.799164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cf914-dbd4-4378-bcc1-ec213ca8c588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:09.799444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cf914-dbd4-4378-bcc1-ec213ca8c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:09.799990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cf914-dbd4-4378-bcc1-ec213ca8c588 admin admin] PATH_INFO: `/v3/projects/2d90e71fbb46465bb69ee4cbc576cf3f/users/4b95ed42f23244c8a3122042e112751d/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:09.807435 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 741/1454] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:09 2022] PUT /identity/v3/projects/4dc631237ed24a3ab7df33824140f915/users/bbf409781e2a4c38b693034beadb68cb/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:09.820999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bc49b-6b7b-4540-afe8-46dc8ccec209 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:09.822453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bc49b-6b7b-4540-afe8-46dc8ccec209 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:09.822935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bc49b-6b7b-4540-afe8-46dc8ccec209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:09.866526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cf914-dbd4-4378-bcc1-ec213ca8c588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d90e71fbb46465bb69ee4cbc576cf3f, user_id=4b95ed42f23244c8a3122042e112751d, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:09.870018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cf914-dbd4-4378-bcc1-ec213ca8c588 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:09.895935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 714/1455] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:09 2022] PUT /identity/v3/projects/2d90e71fbb46465bb69ee4cbc576cf3f/users/4b95ed42f23244c8a3122042e112751d/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:09.897074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cf914-dbd4-4378-bcc1-ec213ca8c588 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:09.899769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f28cf914-dbd4-4378-bcc1-ec213ca8c588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:09.910654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c70bc49b-6b7b-4540-afe8-46dc8ccec209 None None] MFA Rules not processed for user `bbf409781e2a4c38b693034beadb68cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:09.912283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c70bc49b-6b7b-4540-afe8-46dc8ccec209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:09.997919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:10.167102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 742/1456] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:10.168676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bc49b-6b7b-4540-afe8-46dc8ccec209 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:10.189552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cf914-dbd4-4378-bcc1-ec213ca8c588 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:10.216339 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903a807-72d0-4f32-a045-c3768028b33e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:10.222422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903a807-72d0-4f32-a045-c3768028b33e service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:10.224788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903a807-72d0-4f32-a045-c3768028b33e service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:10.225956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903a807-72d0-4f32-a045-c3768028b33e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:10.274418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:10.348685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bc49b-6b7b-4540-afe8-46dc8ccec209 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:10.365017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474db4-88d5-4734-a136-45b7be316031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:10.365987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474db4-88d5-4734-a136-45b7be316031 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:10.366406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474db4-88d5-4734-a136-45b7be316031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:10.366853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474db4-88d5-4734-a136-45b7be316031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:10.367784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84474db4-88d5-4734-a136-45b7be316031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:10.374584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84474db4-88d5-4734-a136-45b7be316031 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:10.399232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 743/1457] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:10.400744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474db4-88d5-4734-a136-45b7be316031 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:10.406255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-84474db4-88d5-4734-a136-45b7be316031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:10.457844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903a807-72d0-4f32-a045-c3768028b33e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:10.460602 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903a807-72d0-4f32-a045-c3768028b33e service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:10.504693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 715/1458] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:24:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:10.505699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903a807-72d0-4f32-a045-c3768028b33e service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:10.560730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903a807-72d0-4f32-a045-c3768028b33e service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:10.580210 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd0f91-127b-465b-97d4-bf645e18ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:10.581278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd0f91-127b-465b-97d4-bf645e18ad93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:10.581663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd0f91-127b-465b-97d4-bf645e18ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:10.582034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd0f91-127b-465b-97d4-bf645e18ad93 admin admin] PATH_INFO: `/v3/projects/2d90e71fbb46465bb69ee4cbc576cf3f/users/4b95ed42f23244c8a3122042e112751d/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:10.584878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd0f91-127b-465b-97d4-bf645e18ad93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d90e71fbb46465bb69ee4cbc576cf3f, user_id=4b95ed42f23244c8a3122042e112751d, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:10.587890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd0f91-127b-465b-97d4-bf645e18ad93 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:10.601595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 716/1459] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:10 2022] PUT /identity/v3/projects/2d90e71fbb46465bb69ee4cbc576cf3f/users/4b95ed42f23244c8a3122042e112751d/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:10.612027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576e23-9eb1-4e07-9f80-bf2d5a396611 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:10.612664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576e23-9eb1-4e07-9f80-bf2d5a396611 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:10.613190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576e23-9eb1-4e07-9f80-bf2d5a396611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:10.617731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474db4-88d5-4734-a136-45b7be316031 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:10.681877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-52576e23-9eb1-4e07-9f80-bf2d5a396611 None None] MFA Rules not processed for user `4b95ed42f23244c8a3122042e112751d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:10.683710 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-52576e23-9eb1-4e07-9f80-bf2d5a396611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:10.749331 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363655c-ecc9-4931-be41-b1510b05cf29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:10.750172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363655c-ecc9-4931-be41-b1510b05cf29 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:10.750457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363655c-ecc9-4931-be41-b1510b05cf29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:10.750804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363655c-ecc9-4931-be41-b1510b05cf29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:10.948554 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363655c-ecc9-4931-be41-b1510b05cf29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:10.950475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363655c-ecc9-4931-be41-b1510b05cf29 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:10.977410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 717/1460] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:10.987650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 744/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:11.032811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576e23-9eb1-4e07-9f80-bf2d5a396611 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:11.048109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576e23-9eb1-4e07-9f80-bf2d5a396611 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:11.056236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eba8a-1919-4818-a880-257a635f85de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:11.057122 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eba8a-1919-4818-a880-257a635f85de service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:11.057249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eba8a-1919-4818-a880-257a635f85de service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:11.057619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eba8a-1919-4818-a880-257a635f85de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:11.092147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eba8a-1919-4818-a880-257a635f85de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:11.093672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eba8a-1919-4818-a880-257a635f85de service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:11.150940 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 718/1462] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:11.350202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363655c-ecc9-4931-be41-b1510b05cf29 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:11.363292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363655c-ecc9-4931-be41-b1510b05cf29 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:11.372417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:11.372417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:11.372417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:11.372417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:11.379740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:11.472006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:11.574138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:11.576338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:11.612452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 745/1463] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:11.806553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eba8a-1919-4818-a880-257a635f85de service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:11.808041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fb7eba8a-1919-4818-a880-257a635f85de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:11.833058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eba8a-1919-4818-a880-257a635f85de service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:11.843910 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb297b-b34d-4fa2-81ba-dc6e1af715af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:11.844569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb297b-b34d-4fa2-81ba-dc6e1af715af service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:11.844853 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb297b-b34d-4fa2-81ba-dc6e1af715af service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:11.845122 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb297b-b34d-4fa2-81ba-dc6e1af715af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:11.848103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d9fb297b-b34d-4fa2-81ba-dc6e1af715af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:11.946463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:12.020470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb297b-b34d-4fa2-81ba-dc6e1af715af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:12.022114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb297b-b34d-4fa2-81ba-dc6e1af715af service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:12.055963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 719/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:13.681413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:13.683776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:13.872874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cc9cb-cda6-4464-bb94-21433a1df1a6 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:13.883026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:13.884330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:13.886511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:13.887650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] PATH_INFO: `/v3/projects/c9e8dc4d4bd142e78f9fb30ddb0b9c6d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:13.890629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e8dc4d4bd142e78f9fb30ddb0b9c6d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:13.902815 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:14.079282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e8dc4d4bd142e78f9fb30ddb0b9c6d', 'request_id': 'req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.116075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e8dc4d4bd142e78f9fb30ddb0b9c6d', 'request_id': 'req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.155682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e8dc4d4bd142e78f9fb30ddb0b9c6d', 'request_id': 'req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.259048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] The token cache is being invalidate because project c9e8dc4d4bd142e78f9fb30ddb0b9c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:14.259359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.262138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d01d3e6c-7f15-4fbc-83fe-dc6a6dc5ad5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.269206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 746/1465] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:13 2022] DELETE /identity/v3/projects/c9e8dc4d4bd142e78f9fb30ddb0b9c6d => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:14.273562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb297b-b34d-4fa2-81ba-dc6e1af715af service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:14.280480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e7ad6-bf37-47f5-9dce-d64a1f59928a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:14.280765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e7ad6-bf37-47f5-9dce-d64a1f59928a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:14.281043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e7ad6-bf37-47f5-9dce-d64a1f59928a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:14.297717 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb297b-b34d-4fa2-81ba-dc6e1af715af service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:14.363793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-927e7ad6-bf37-47f5-9dce-d64a1f59928a None None] MFA Rules not processed for user `6ae71e9e597240ee88c6bd0754244aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:14.365070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-927e7ad6-bf37-47f5-9dce-d64a1f59928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:14.476895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:14.477594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:14.477901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:14.478827 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] PATH_INFO: `/v3/users/2a76b26191564da9857e9f6bcdcf31aa` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:14.481594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a76b26191564da9857e9f6bcdcf31aa)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:14.483600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:14.504290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 747/1466] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 27 01:24:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:14.595780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a76b26191564da9857e9f6bcdcf31aa'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.613541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a76b26191564da9857e9f6bcdcf31aa'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.649472 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a76b26191564da9857e9f6bcdcf31aa'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.694315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a76b26191564da9857e9f6bcdcf31aa'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.694315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a76b26191564da9857e9f6bcdcf31aa'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:14.731545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 720/1467] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:14 2022] DELETE /identity/v3/users/2a76b26191564da9857e9f6bcdcf31aa => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:14.793676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e7ad6-bf37-47f5-9dce-d64a1f59928a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:14.795293 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-927e7ad6-bf37-47f5-9dce-d64a1f59928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:14.834944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e7ad6-bf37-47f5-9dce-d64a1f59928a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:14.894215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:15.028839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d9835-c9b5-44ab-aab7-eec4780f7d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:15.029854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9835-c9b5-44ab-aab7-eec4780f7d44 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:15.030781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9835-c9b5-44ab-aab7-eec4780f7d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:15.031879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9835-c9b5-44ab-aab7-eec4780f7d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:15.036216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-709d9835-c9b5-44ab-aab7-eec4780f7d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:15.072288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d9835-c9b5-44ab-aab7-eec4780f7d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:15.074613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d9835-c9b5-44ab-aab7-eec4780f7d44 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:15.115539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 748/1468] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:15.952354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:15.954998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:16.149282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:16.189221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438ed48-fe1b-4899-8828-07a9a6b2c0d5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:16.211195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:16.212246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:16.212740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:16.213285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] PATH_INFO: `/v3/users/e58b039acd3d4148a6d637c72df5b759` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:16.215513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58b039acd3d4148a6d637c72df5b759)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:16.221154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:16.256155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe802f4a-afeb-4007-b65c-0b9478d4a9ec None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:16.257078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe802f4a-afeb-4007-b65c-0b9478d4a9ec None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:16.257515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe802f4a-afeb-4007-b65c-0b9478d4a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:16.315984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fe802f4a-afeb-4007-b65c-0b9478d4a9ec None None] MFA Rules not processed for user `563728f1570c48c3b79bf36e32681a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:16.317354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fe802f4a-afeb-4007-b65c-0b9478d4a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:16.396350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58b039acd3d4148a6d637c72df5b759'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.431563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58b039acd3d4148a6d637c72df5b759'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.467640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58b039acd3d4148a6d637c72df5b759'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.510001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58b039acd3d4148a6d637c72df5b759'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.511079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58b039acd3d4148a6d637c72df5b759'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.521895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 749/1469] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:16.537966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 721/1470] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:15 2022] DELETE /identity/v3/users/e58b039acd3d4148a6d637c72df5b759 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:16.543279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989dbf1-f9d5-4950-ab93-cb32602d6f3b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:16.543865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989dbf1-f9d5-4950-ab93-cb32602d6f3b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:16.544410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989dbf1-f9d5-4950-ab93-cb32602d6f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:16.589086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7989dbf1-f9d5-4950-ab93-cb32602d6f3b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:16.597681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7989dbf1-f9d5-4950-ab93-cb32602d6f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:16.807648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 750/1471] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:17.259840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:17.262963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:17.448918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4610e58-c7fe-43ba-a9ce-f0803808abd1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:17.460837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494deecf-29bb-4dd0-aa88-7dd266f73120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:17.461534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494deecf-29bb-4dd0-aa88-7dd266f73120 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:17.461820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494deecf-29bb-4dd0-aa88-7dd266f73120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:17.462098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494deecf-29bb-4dd0-aa88-7dd266f73120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:17.498158 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494deecf-29bb-4dd0-aa88-7dd266f73120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:17.500024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494deecf-29bb-4dd0-aa88-7dd266f73120 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:17.536445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989dbf1-f9d5-4950-ab93-cb32602d6f3b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:17.538155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7989dbf1-f9d5-4950-ab93-cb32602d6f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:17.575319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 722/1472] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:17.577437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989dbf1-f9d5-4950-ab93-cb32602d6f3b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:17.593878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:17.594567 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:17.594875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:17.595195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] PATH_INFO: `/v3/users/bc698bef253f4f6e99918ecb5125c39c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:17.601803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc698bef253f4f6e99918ecb5125c39c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:17.603955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:17.760364 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc698bef253f4f6e99918ecb5125c39c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.783652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc698bef253f4f6e99918ecb5125c39c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.802285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:17.813119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc698bef253f4f6e99918ecb5125c39c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.814361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc698bef253f4f6e99918ecb5125c39c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.850070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc698bef253f4f6e99918ecb5125c39c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.861334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 751/1473] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:17 2022] DELETE /identity/v3/users/bc698bef253f4f6e99918ecb5125c39c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:17.867113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0761-27ba-4966-ae78-d68eb0421593 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:17.867518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0761-27ba-4966-ae78-d68eb0421593 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:17.867714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0761-27ba-4966-ae78-d68eb0421593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:17.945998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4a4e0761-27ba-4966-ae78-d68eb0421593 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:17.964166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4a4e0761-27ba-4966-ae78-d68eb0421593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.100672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:18.102431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.122262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 723/1474] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:18.135580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae02457-b66f-49e7-a86c-8f4f5d7af6c6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:18.149159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:18.149807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:18.150239 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:18.157256 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] PATH_INFO: `/v3/users/e35033c499054caba3af9aeb99c3d4eb` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:18.161021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35033c499054caba3af9aeb99c3d4eb)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:18.174492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:18.230749 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0761-27ba-4966-ae78-d68eb0421593 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:18.232783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4a4e0761-27ba-4966-ae78-d68eb0421593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.262369 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:18.301034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35033c499054caba3af9aeb99c3d4eb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:18.319784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35033c499054caba3af9aeb99c3d4eb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:18.345180 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35033c499054caba3af9aeb99c3d4eb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:18.346793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35033c499054caba3af9aeb99c3d4eb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:18.375116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0761-27ba-4966-ae78-d68eb0421593 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:18.379607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13361db0-cbfd-43e9-a7d5-b4001311b744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35033c499054caba3af9aeb99c3d4eb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:18.388910 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:18.390002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:18.391718 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:18.392886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:18.400505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.406770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 752/1475] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:18 2022] DELETE /identity/v3/users/e35033c499054caba3af9aeb99c3d4eb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:18.411479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171043d-7d51-468d-ae4c-78a09ca6bac0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:18.412127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171043d-7d51-468d-ae4c-78a09ca6bac0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:18.413162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171043d-7d51-468d-ae4c-78a09ca6bac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:18.457092 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:18.461037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:18.487187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2171043d-7d51-468d-ae4c-78a09ca6bac0 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:18.489916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 724/1476] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:18.491920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2171043d-7d51-468d-ae4c-78a09ca6bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.690859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 753/1477] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:18.801312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:18.803209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.847150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cddd4a-c4fc-4a28-85a5-8752a95e8f8f service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:18.973869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171043d-7d51-468d-ae4c-78a09ca6bac0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:18.978578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2171043d-7d51-468d-ae4c-78a09ca6bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:19.002163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171043d-7d51-468d-ae4c-78a09ca6bac0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:19.016282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:19.019011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:19.019486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:19.020001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] PATH_INFO: `/v3/projects/0c6e56448ad14688a37b07b54aa52c84` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:19.023628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad1438-a806-427c-93e9-29d0ab1ac94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:19.024826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6e56448ad14688a37b07b54aa52c84)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:19.028184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad1438-a806-427c-93e9-29d0ab1ac94e service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:19.030140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad1438-a806-427c-93e9-29d0ab1ac94e service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:19.030846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:19.030972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad1438-a806-427c-93e9-29d0ab1ac94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:19.069076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad1438-a806-427c-93e9-29d0ab1ac94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:19.072563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad1438-a806-427c-93e9-29d0ab1ac94e service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:19.110280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 725/1478] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:19.114012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaab09-620f-4d5d-8054-273ea79a06b3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:19.114305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaab09-620f-4d5d-8054-273ea79a06b3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:19.114584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaab09-620f-4d5d-8054-273ea79a06b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:19.143658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:19.154261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6e56448ad14688a37b07b54aa52c84', 'request_id': 'req-db34da13-a7a6-4c54-b637-f776d03b31b5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:19.163412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-badaab09-620f-4d5d-8054-273ea79a06b3 None None] MFA Rules not processed for user `c37589330ceb4193a7a504600b4ced84`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:19.168118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-badaab09-620f-4d5d-8054-273ea79a06b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:19.173221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6e56448ad14688a37b07b54aa52c84', 'request_id': 'req-db34da13-a7a6-4c54-b637-f776d03b31b5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:19.183977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6e56448ad14688a37b07b54aa52c84', 'request_id': 'req-db34da13-a7a6-4c54-b637-f776d03b31b5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:19.202994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] The token cache is being invalidate because project 0c6e56448ad14688a37b07b54aa52c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:19.203365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:19.203939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db34da13-a7a6-4c54-b637-f776d03b31b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:19.205873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 754/1479] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:18 2022] DELETE /identity/v3/projects/0c6e56448ad14688a37b07b54aa52c84 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:19.217753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14d000-5548-40ea-8152-82f6d705083c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:19.217753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14d000-5548-40ea-8152-82f6d705083c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:19.217753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14d000-5548-40ea-8152-82f6d705083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:19.241843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6d14d000-5548-40ea-8152-82f6d705083c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:19.244773 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6d14d000-5548-40ea-8152-82f6d705083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:19.327630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 726/1480] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:19.410210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 755/1481] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:19.417904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff987c-3356-45d6-82d8-7dcdae49464d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:19.418179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff987c-3356-45d6-82d8-7dcdae49464d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:19.418463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff987c-3356-45d6-82d8-7dcdae49464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:19.461877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c6ff987c-3356-45d6-82d8-7dcdae49464d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:19.463317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c6ff987c-3356-45d6-82d8-7dcdae49464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:19.483357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 727/1482] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:19.488359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14d000-5548-40ea-8152-82f6d705083c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:19.512432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14d000-5548-40ea-8152-82f6d705083c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:19.518327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f05e9a-b0d8-4452-83f3-8b6dcb8a0fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:19.519350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f05e9a-b0d8-4452-83f3-8b6dcb8a0fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:19.519717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f05e9a-b0d8-4452-83f3-8b6dcb8a0fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:19.520184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f05e9a-b0d8-4452-83f3-8b6dcb8a0fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:19.521100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f05e9a-b0d8-4452-83f3-8b6dcb8a0fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:19.521745 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f05e9a-b0d8-4452-83f3-8b6dcb8a0fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:19.524222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f05e9a-b0d8-4452-83f3-8b6dcb8a0fbe admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:19.579406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 756/1483] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:19.584894 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff987c-3356-45d6-82d8-7dcdae49464d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:19.603961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff987c-3356-45d6-82d8-7dcdae49464d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:19.618774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9ee9e-d5b1-4c24-8708-43ea5dfd611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:19.620521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9ee9e-d5b1-4c24-8708-43ea5dfd611b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:19.622039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9ee9e-d5b1-4c24-8708-43ea5dfd611b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:19.624422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9ee9e-d5b1-4c24-8708-43ea5dfd611b admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:19.625209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9ee9e-d5b1-4c24-8708-43ea5dfd611b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:19.627434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9ee9e-d5b1-4c24-8708-43ea5dfd611b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:19.707081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f05e9a-b0d8-4452-83f3-8b6dcb8a0fbe admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:19.709030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 728/1484] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:19 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:19.743687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f05e9a-b0d8-4452-83f3-8b6dcb8a0fbe admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:19.897807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f799b4-d3e3-4ec9-a838-a515179a47a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:19.898943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f799b4-d3e3-4ec9-a838-a515179a47a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:19.899469 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f799b4-d3e3-4ec9-a838-a515179a47a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:19.899956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f799b4-d3e3-4ec9-a838-a515179a47a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:19.901627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f799b4-d3e3-4ec9-a838-a515179a47a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:19.905308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f799b4-d3e3-4ec9-a838-a515179a47a1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:19.942232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 757/1485] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:19 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:19.952110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9ee9e-d5b1-4c24-8708-43ea5dfd611b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:20.002517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f799b4-d3e3-4ec9-a838-a515179a47a1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:20.006162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a3f799b4-d3e3-4ec9-a838-a515179a47a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:20.025688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9ee9e-d5b1-4c24-8708-43ea5dfd611b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:20.053239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759907-edfa-42e0-bb69-f3ec32d7613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:20.053946 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759907-edfa-42e0-bb69-f3ec32d7613c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:20.054252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759907-edfa-42e0-bb69-f3ec32d7613c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:20.054526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759907-edfa-42e0-bb69-f3ec32d7613c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:20.055246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8759907-edfa-42e0-bb69-f3ec32d7613c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:20.057016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8759907-edfa-42e0-bb69-f3ec32d7613c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:20.059713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f799b4-d3e3-4ec9-a838-a515179a47a1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:20.084858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:20.084858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:20.084858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:20.084858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] PATH_INFO: `/v3/projects/525f6df8e94e484ca6f5a757492e93a2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:20.091103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=525f6df8e94e484ca6f5a757492e93a2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:20.091891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 729/1486] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:20.097059 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759907-edfa-42e0-bb69-f3ec32d7613c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:20.099905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:20.120408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759907-edfa-42e0-bb69-f3ec32d7613c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:20.169121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a24f83-daf9-4c14-a4f3-084a7933eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:20.169771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a24f83-daf9-4c14-a4f3-084a7933eaec admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:20.170053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a24f83-daf9-4c14-a4f3-084a7933eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:20.170382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a24f83-daf9-4c14-a4f3-084a7933eaec admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:20.174082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a24f83-daf9-4c14-a4f3-084a7933eaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:20.175906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a24f83-daf9-4c14-a4f3-084a7933eaec admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:20.219106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 730/1487] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:20.227009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a24f83-daf9-4c14-a4f3-084a7933eaec admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:20.248622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a24f83-daf9-4c14-a4f3-084a7933eaec admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:20.270257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:20.273817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:20.299036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525f6df8e94e484ca6f5a757492e93a2', 'request_id': 'req-6c7251e4-d53c-47cb-805f-21003311e02a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.323693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525f6df8e94e484ca6f5a757492e93a2', 'request_id': 'req-6c7251e4-d53c-47cb-805f-21003311e02a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.344399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525f6df8e94e484ca6f5a757492e93a2', 'request_id': 'req-6c7251e4-d53c-47cb-805f-21003311e02a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.378907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] The token cache is being invalidate because project 525f6df8e94e484ca6f5a757492e93a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:20.380661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.382077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.386616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b36cd2-cfd0-40e0-9e62-bf5a996b5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:20.388242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 758/1488] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:19 2022] DELETE /identity/v3/projects/525f6df8e94e484ca6f5a757492e93a2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:20.388456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b36cd2-cfd0-40e0-9e62-bf5a996b5f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:20.388851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b36cd2-cfd0-40e0-9e62-bf5a996b5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:20.389022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b36cd2-cfd0-40e0-9e62-bf5a996b5f3b admin admin] PATH_INFO: `/v3/projects/b4a07e466a904e0db02607ad67e1ffc5/users/515b9514ff864e08ac9b5d29d87c31df/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:20.393185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:20.396042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:20.445249 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7251e4-d53c-47cb-805f-21003311e02a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:20.451089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b36cd2-cfd0-40e0-9e62-bf5a996b5f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a07e466a904e0db02607ad67e1ffc5, user_id=515b9514ff864e08ac9b5d29d87c31df, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:20.458634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b36cd2-cfd0-40e0-9e62-bf5a996b5f3b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:20.459417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:20.461606 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:20.461902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:20.462185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] PATH_INFO: `/v3/users/bbf409781e2a4c38b693034beadb68cb` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:20.466140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf409781e2a4c38b693034beadb68cb)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:20.472030 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:20.493872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 731/1489] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:20 2022] PUT /identity/v3/projects/b4a07e466a904e0db02607ad67e1ffc5/users/515b9514ff864e08ac9b5d29d87c31df/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:20.506091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31f422-a0d7-4307-aa6e-b62075289bca None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:20.506598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31f422-a0d7-4307-aa6e-b62075289bca None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:20.506913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31f422-a0d7-4307-aa6e-b62075289bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:20.572477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2f31f422-a0d7-4307-aa6e-b62075289bca None None] MFA Rules not processed for user `515b9514ff864e08ac9b5d29d87c31df`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:20.574905 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2f31f422-a0d7-4307-aa6e-b62075289bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:20.608964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf409781e2a4c38b693034beadb68cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.629446 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf409781e2a4c38b693034beadb68cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.651979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf409781e2a4c38b693034beadb68cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.654372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf409781e2a4c38b693034beadb68cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.698573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf409781e2a4c38b693034beadb68cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:20.717887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 732/1490] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:20.725509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 759/1491] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:20 2022] DELETE /identity/v3/users/bbf409781e2a4c38b693034beadb68cb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:20.730451 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31f422-a0d7-4307-aa6e-b62075289bca None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:20.732266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:20.732529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2f31f422-a0d7-4307-aa6e-b62075289bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:20.736471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:20.949813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31f422-a0d7-4307-aa6e-b62075289bca None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:20.961483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc11ca-11ab-47f9-8485-9d3a13be3d59 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:20.970517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e22575-7447-476b-be7f-101e28b73be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:20.972586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e22575-7447-476b-be7f-101e28b73be8 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:20.972877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e22575-7447-476b-be7f-101e28b73be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:20.973145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e22575-7447-476b-be7f-101e28b73be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:21.045229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:21.105452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:21.106184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:21.106471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:21.109074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] PATH_INFO: `/v3/projects/df47985955e94d4c9f47dd7c29151bf4` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:21.110556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df47985955e94d4c9f47dd7c29151bf4)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:21.117929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:21.193952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e22575-7447-476b-be7f-101e28b73be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:21.195720 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e22575-7447-476b-be7f-101e28b73be8 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:21.220568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:21.247570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 760/1492] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:21.274493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e22575-7447-476b-be7f-101e28b73be8 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:21.276549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-06e22575-7447-476b-be7f-101e28b73be8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:21.282812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df47985955e94d4c9f47dd7c29151bf4', 'request_id': 'req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.307776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e22575-7447-476b-be7f-101e28b73be8 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:21.308305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df47985955e94d4c9f47dd7c29151bf4', 'request_id': 'req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.329503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df47985955e94d4c9f47dd7c29151bf4', 'request_id': 'req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.359322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] The token cache is being invalidate because project df47985955e94d4c9f47dd7c29151bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:21.359740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.360384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.365771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 733/1493] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:20 2022] DELETE /identity/v3/projects/df47985955e94d4c9f47dd7c29151bf4 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:21.367165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:21.386232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:21.467449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:21.467792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:21.468005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:21.468281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] PATH_INFO: `/v3/users/515b9514ff864e08ac9b5d29d87c31df` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:21.470223 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=515b9514ff864e08ac9b5d29d87c31df)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:21.475443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:21.583212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515b9514ff864e08ac9b5d29d87c31df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.596489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515b9514ff864e08ac9b5d29d87c31df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.612494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4fda3-93a6-4fdd-bce0-cd50a5c45e07 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:21.616604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515b9514ff864e08ac9b5d29d87c31df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.621394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515b9514ff864e08ac9b5d29d87c31df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.629073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:21.638424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:21.639602 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:21.641124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] PATH_INFO: `/v3/users/4b95ed42f23244c8a3122042e112751d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:21.644549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b95ed42f23244c8a3122042e112751d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:21.651068 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:21.674628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515b9514ff864e08ac9b5d29d87c31df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.698456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 761/1494] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:21 2022] DELETE /identity/v3/users/515b9514ff864e08ac9b5d29d87c31df => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:21.700230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:21.704502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:21.796567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b95ed42f23244c8a3122042e112751d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.805913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b95ed42f23244c8a3122042e112751d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.824037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:21.835177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b95ed42f23244c8a3122042e112751d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.854645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b95ed42f23244c8a3122042e112751d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.856546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-aa0d2a57-1f90-4ae5-a4b6-b1df022b21a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b95ed42f23244c8a3122042e112751d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:21.878654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 734/1495] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:21 2022] DELETE /identity/v3/users/4b95ed42f23244c8a3122042e112751d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:21.880747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c755589-8115-43d8-b81c-5bd6747d43f8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:21.881186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c755589-8115-43d8-b81c-5bd6747d43f8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:21.882023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c755589-8115-43d8-b81c-5bd6747d43f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:21.921031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4978cd8-3937-4d6b-b0fb-1ce0f7b81a04 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:21.937305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6c755589-8115-43d8-b81c-5bd6747d43f8 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:21.941806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6c755589-8115-43d8-b81c-5bd6747d43f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:21.968967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:22.090437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 735/1496] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:22.092503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:22.093281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.093561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.093838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] PATH_INFO: `/v3/projects/1c8e819470244f3481838fa025911301` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.097619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8e819470244f3481838fa025911301)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:22.102918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:22.132132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d433d1f-5908-4d3d-bd72-fbbb79e3e1be None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.132453 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d433d1f-5908-4d3d-bd72-fbbb79e3e1be None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.132711 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d433d1f-5908-4d3d-bd72-fbbb79e3e1be None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.134533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 736/1497] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:24:22.210965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8e819470244f3481838fa025911301', 'request_id': 'req-5a8cc260-c11c-4acb-ad74-7708ec3816b4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:22.218082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8e819470244f3481838fa025911301', 'request_id': 'req-5a8cc260-c11c-4acb-ad74-7708ec3816b4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:22.227887 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8e819470244f3481838fa025911301', 'request_id': 'req-5a8cc260-c11c-4acb-ad74-7708ec3816b4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:22.238372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d433d1f-5908-4d3d-bd72-fbbb79e3e1be None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:22.240606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1d433d1f-5908-4d3d-bd72-fbbb79e3e1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:22.246335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] The token cache is being invalidate because project 1c8e819470244f3481838fa025911301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:22.246829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:22.247732 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5a8cc260-c11c-4acb-ad74-7708ec3816b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:22.253257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 762/1498] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:21 2022] DELETE /identity/v3/projects/1c8e819470244f3481838fa025911301 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:22.253257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4953a20-63f0-4773-bc58-63dd9c8f45a3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.253524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4953a20-63f0-4773-bc58-63dd9c8f45a3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.253712 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4953a20-63f0-4773-bc58-63dd9c8f45a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.283831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d4953a20-63f0-4773-bc58-63dd9c8f45a3 None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:22.285277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d4953a20-63f0-4773-bc58-63dd9c8f45a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:22.391025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d433d1f-5908-4d3d-bd72-fbbb79e3e1be None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:22.399268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aca13-2858-4e75-8f3e-cc09cfe48142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:22.400015 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aca13-2858-4e75-8f3e-cc09cfe48142 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.400314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aca13-2858-4e75-8f3e-cc09cfe48142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.400758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aca13-2858-4e75-8f3e-cc09cfe48142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.418468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 763/1499] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:22.421903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf64a-72dc-4d08-b755-71d78ebd969e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.422370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf64a-72dc-4d08-b755-71d78ebd969e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.422646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf64a-72dc-4d08-b755-71d78ebd969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.426430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-be0aca13-2858-4e75-8f3e-cc09cfe48142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:22.460830 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-92acf64a-72dc-4d08-b755-71d78ebd969e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:22.462892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-92acf64a-72dc-4d08-b755-71d78ebd969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:22.540923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:22.604038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aca13-2858-4e75-8f3e-cc09cfe48142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:22.604580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aca13-2858-4e75-8f3e-cc09cfe48142 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:22.609600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 764/1500] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:22.617351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707a64b-9f4c-410a-8cde-b6ad9bc584c1 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.617755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707a64b-9f4c-410a-8cde-b6ad9bc584c1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.618306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707a64b-9f4c-410a-8cde-b6ad9bc584c1 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.620111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 737/1501] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:22.622874 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb67e1-0e7f-4154-993c-b7d6fad56fb2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.623245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb67e1-0e7f-4154-993c-b7d6fad56fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.623641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb67e1-0e7f-4154-993c-b7d6fad56fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.631895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 765/1502] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:24:22 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:24:22.647931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-89eb67e1-0e7f-4154-993c-b7d6fad56fb2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:22.649214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-89eb67e1-0e7f-4154-993c-b7d6fad56fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:22.662695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 738/1503] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:22.663350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707a64b-9f4c-410a-8cde-b6ad9bc584c1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:22.677942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707a64b-9f4c-410a-8cde-b6ad9bc584c1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:22.683253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c457-d81a-4b98-80b3-90af8a4112cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:22.683997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c457-d81a-4b98-80b3-90af8a4112cc admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.684291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c457-d81a-4b98-80b3-90af8a4112cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.684781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c457-d81a-4b98-80b3-90af8a4112cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.685681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979c457-d81a-4b98-80b3-90af8a4112cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:22.686055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979c457-d81a-4b98-80b3-90af8a4112cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:22.687790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979c457-d81a-4b98-80b3-90af8a4112cc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:22.706771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb67e1-0e7f-4154-993c-b7d6fad56fb2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:22.713406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 766/1504] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:22.716451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f1af-c770-418e-9a45-ae38b871a29c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.716720 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f1af-c770-418e-9a45-ae38b871a29c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.716988 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f1af-c770-418e-9a45-ae38b871a29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.721353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb67e1-0e7f-4154-993c-b7d6fad56fb2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:22.731353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b580cf9-f28c-45b6-895a-2c11b54e3336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:22.732134 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b580cf9-f28c-45b6-895a-2c11b54e3336 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.732424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b580cf9-f28c-45b6-895a-2c11b54e3336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.732704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b580cf9-f28c-45b6-895a-2c11b54e3336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.733356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b580cf9-f28c-45b6-895a-2c11b54e3336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:22.737473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b580cf9-f28c-45b6-895a-2c11b54e3336 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:22.764487 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0982f1af-c770-418e-9a45-ae38b871a29c None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:22.767673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0982f1af-c770-418e-9a45-ae38b871a29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:22.798390 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 767/1505] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:22.806776 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 739/1506] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:22 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:22.808590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f1af-c770-418e-9a45-ae38b871a29c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:22.820012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f1af-c770-418e-9a45-ae38b871a29c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:22.932929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2070d-9b9c-4b4b-b586-7af1e0d82ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:22.933631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2070d-9b9c-4b4b-b586-7af1e0d82ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.934003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2070d-9b9c-4b4b-b586-7af1e0d82ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.934294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2070d-9b9c-4b4b-b586-7af1e0d82ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.935073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2070d-9b9c-4b4b-b586-7af1e0d82ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:22.937006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2070d-9b9c-4b4b-b586-7af1e0d82ce1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:22.964208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 768/1507] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:22 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:22.968611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b580cf9-f28c-45b6-895a-2c11b54e3336 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:22.981849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b580cf9-f28c-45b6-895a-2c11b54e3336 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:22.986996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f72b-e60b-45c2-813d-203bbd84783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:22.987714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f72b-e60b-45c2-813d-203bbd84783d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:22.988106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f72b-e60b-45c2-813d-203bbd84783d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:22.988450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f72b-e60b-45c2-813d-203bbd84783d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:22.989221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437f72b-e60b-45c2-813d-203bbd84783d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:22.990963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437f72b-e60b-45c2-813d-203bbd84783d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:22.994287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:23.014416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2070d-9b9c-4b4b-b586-7af1e0d82ce1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:23.022096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 740/1508] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:23.028507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2070d-9b9c-4b4b-b586-7af1e0d82ce1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:23.033945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e34b1-fa2d-4cd2-b97a-09a13f01e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:23.034709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e34b1-fa2d-4cd2-b97a-09a13f01e205 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.035127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e34b1-fa2d-4cd2-b97a-09a13f01e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.035497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e34b1-fa2d-4cd2-b97a-09a13f01e205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.036421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e34b1-fa2d-4cd2-b97a-09a13f01e205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:23.039857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e34b1-fa2d-4cd2-b97a-09a13f01e205 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:23.055666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 769/1509] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:23.057296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f72b-e60b-45c2-813d-203bbd84783d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:23.070216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e34b1-fa2d-4cd2-b97a-09a13f01e205 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:23.072022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-674e34b1-fa2d-4cd2-b97a-09a13f01e205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:23.074469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f72b-e60b-45c2-813d-203bbd84783d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:23.082596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc499d-4d72-47b5-8dd3-29fae54d25c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:23.084396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc499d-4d72-47b5-8dd3-29fae54d25c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.086040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc499d-4d72-47b5-8dd3-29fae54d25c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.086475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc499d-4d72-47b5-8dd3-29fae54d25c1 admin admin] PATH_INFO: `/v3/projects/288513a6ce944412b7bb189c138c806b/users/da93021faf554a1fbae05e2d9d3e0e00/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.088119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e34b1-fa2d-4cd2-b97a-09a13f01e205 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:23.094528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:23.095809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.096139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.096440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] PATH_INFO: `/v3/projects/4dc631237ed24a3ab7df33824140f915` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.097845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc631237ed24a3ab7df33824140f915)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:23.100549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:23.112200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc499d-4d72-47b5-8dd3-29fae54d25c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=288513a6ce944412b7bb189c138c806b, user_id=da93021faf554a1fbae05e2d9d3e0e00, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:23.116014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc499d-4d72-47b5-8dd3-29fae54d25c1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:23.159726 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 741/1510] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:23 2022] PUT /identity/v3/projects/288513a6ce944412b7bb189c138c806b/users/da93021faf554a1fbae05e2d9d3e0e00/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:23.171398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc631237ed24a3ab7df33824140f915', 'request_id': 'req-e990ae04-eed8-4474-bc4e-872b554329f9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.171543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad13d45-e2f6-4f24-b663-63854cb6fbdc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.171918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad13d45-e2f6-4f24-b663-63854cb6fbdc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.172297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad13d45-e2f6-4f24-b663-63854cb6fbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.180430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc631237ed24a3ab7df33824140f915', 'request_id': 'req-e990ae04-eed8-4474-bc4e-872b554329f9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.192352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc631237ed24a3ab7df33824140f915', 'request_id': 'req-e990ae04-eed8-4474-bc4e-872b554329f9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.209060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6ad13d45-e2f6-4f24-b663-63854cb6fbdc None None] MFA Rules not processed for user `da93021faf554a1fbae05e2d9d3e0e00`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:23.210543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6ad13d45-e2f6-4f24-b663-63854cb6fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:23.212454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] The token cache is being invalidate because project 4dc631237ed24a3ab7df33824140f915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:23.212746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.213701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e990ae04-eed8-4474-bc4e-872b554329f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.220437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 770/1511] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:23 2022] DELETE /identity/v3/projects/4dc631237ed24a3ab7df33824140f915 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:23.222925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb01c3-0346-4786-a564-220f3e86c75d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.223341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb01c3-0346-4786-a564-220f3e86c75d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.223652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb01c3-0346-4786-a564-220f3e86c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.260007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f7fb01c3-0346-4786-a564-220f3e86c75d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:23.261217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f7fb01c3-0346-4786-a564-220f3e86c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:23.343111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:23.390177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 742/1512] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:23.395825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad13d45-e2f6-4f24-b663-63854cb6fbdc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:23.400841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6ad13d45-e2f6-4f24-b663-63854cb6fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:23.453165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 771/1513] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:23.461529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1d033-afcf-41f3-b920-643ec67a0d95 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.461722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1d033-afcf-41f3-b920-643ec67a0d95 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.462009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1d033-afcf-41f3-b920-643ec67a0d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.493453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-92f1d033-afcf-41f3-b920-643ec67a0d95 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:23.494922 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-92f1d033-afcf-41f3-b920-643ec67a0d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:23.509397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 772/1514] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:23.517068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1d033-afcf-41f3-b920-643ec67a0d95 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:23.537004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1d033-afcf-41f3-b920-643ec67a0d95 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:23.538650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad13d45-e2f6-4f24-b663-63854cb6fbdc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:23.545283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:23.546828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.547362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.547527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2b3c-c9be-478e-919b-67b649348d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:23.548288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2b3c-c9be-478e-919b-67b649348d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.548493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.548595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2b3c-c9be-478e-919b-67b649348d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.548942 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2b3c-c9be-478e-919b-67b649348d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.550148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c2b3c-c9be-478e-919b-67b649348d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:23.550537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:23.551086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:23.552573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c2b3c-c9be-478e-919b-67b649348d67 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:23.553700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:23.576669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 773/1515] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:23.578639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:23.585446 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:23.600996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 743/1516] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:23 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:23.602709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2b3c-c9be-478e-919b-67b649348d67 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:23.606372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7b1f7-a6ac-402f-83a0-05348ea3be8a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:23.692471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:23.715641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2b3c-c9be-478e-919b-67b649348d67 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:23.723054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625540-5303-41bc-b721-53e6635733c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:23.723770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625540-5303-41bc-b721-53e6635733c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.724243 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625540-5303-41bc-b721-53e6635733c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.724611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625540-5303-41bc-b721-53e6635733c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.725607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05625540-5303-41bc-b721-53e6635733c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:23.728086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05625540-5303-41bc-b721-53e6635733c4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:23.765287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:23.765875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:23.766153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:23.766422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] PATH_INFO: `/v3/projects/2d90e71fbb46465bb69ee4cbc576cf3f` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:23.769018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d90e71fbb46465bb69ee4cbc576cf3f)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:23.769684 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:23.794275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 744/1517] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:23 2022] POST /identity/v3/projects => generated 405 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:23.796929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625540-5303-41bc-b721-53e6635733c4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:23.911871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d90e71fbb46465bb69ee4cbc576cf3f', 'request_id': 'req-2c00342d-dd53-4272-93c3-7c422a878f22'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.918883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d90e71fbb46465bb69ee4cbc576cf3f', 'request_id': 'req-2c00342d-dd53-4272-93c3-7c422a878f22'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.941788 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d90e71fbb46465bb69ee4cbc576cf3f', 'request_id': 'req-2c00342d-dd53-4272-93c3-7c422a878f22'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.958585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] The token cache is being invalidate because project 2d90e71fbb46465bb69ee4cbc576cf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:23.959010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.959594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:23.968631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 774/1518] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:23 2022] DELETE /identity/v3/projects/2d90e71fbb46465bb69ee4cbc576cf3f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:23.969232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:23.971401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:23.980562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625540-5303-41bc-b721-53e6635733c4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.091637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:24.093314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf80d3-b18b-43c6-ac87-3ab2d055f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.094293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf80d3-b18b-43c6-ac87-3ab2d055f5ff admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.095027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf80d3-b18b-43c6-ac87-3ab2d055f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.095477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf80d3-b18b-43c6-ac87-3ab2d055f5ff admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.096359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf80d3-b18b-43c6-ac87-3ab2d055f5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.100097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf80d3-b18b-43c6-ac87-3ab2d055f5ff admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.141181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00342d-dd53-4272-93c3-7c422a878f22 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.141371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 745/1519] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:23 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:24.142906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf80d3-b18b-43c6-ac87-3ab2d055f5ff admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.148268 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-75cf80d3-b18b-43c6-ac87-3ab2d055f5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.148643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.149994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.150358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.150703 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.153018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.170647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.172369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.173460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf80d3-b18b-43c6-ac87-3ab2d055f5ff admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.181475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030ea4b-199f-4c3c-a06d-0a47533ed626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.182304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ea4b-199f-4c3c-a06d-0a47533ed626 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.182824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ea4b-199f-4c3c-a06d-0a47533ed626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.183294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ea4b-199f-4c3c-a06d-0a47533ed626 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.184152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ea4b-199f-4c3c-a06d-0a47533ed626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.186941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ea4b-199f-4c3c-a06d-0a47533ed626 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.192614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 775/1520] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:24.196964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.198829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.228257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010814-2fb5-424c-9974-4077c60cb08e service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.235737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.236369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.236653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.236981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.238892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.247193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 746/1521] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:24 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:24.247193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d6ed-7a97-4443-9fb6-fcbc5f07951e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.247193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d6ed-7a97-4443-9fb6-fcbc5f07951e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.247193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d6ed-7a97-4443-9fb6-fcbc5f07951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.255162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.256945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.272308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 776/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:24.273105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.275247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.287201 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6490d6ed-7a97-4443-9fb6-fcbc5f07951e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:24.288296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6490d6ed-7a97-4443-9fb6-fcbc5f07951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.306996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 747/1523] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:24.308059 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d6ed-7a97-4443-9fb6-fcbc5f07951e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.312157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6490d6ed-7a97-4443-9fb6-fcbc5f07951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.330181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1863bb-6846-4dec-929a-34bd69fd651c service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.339209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d6ed-7a97-4443-9fb6-fcbc5f07951e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.341333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee754c-27e4-4c13-b78b-df1cebef4433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.342143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee754c-27e4-4c13-b78b-df1cebef4433 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.342564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee754c-27e4-4c13-b78b-df1cebef4433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.343021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee754c-27e4-4c13-b78b-df1cebef4433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.345101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee754c-27e4-4c13-b78b-df1cebef4433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.347107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee754c-27e4-4c13-b78b-df1cebef4433 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.357685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.358368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.358751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.358950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] PATH_INFO: `/v3/projects/b4a07e466a904e0db02607ad67e1ffc5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.360733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a07e466a904e0db02607ad67e1ffc5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.362578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.383350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 777/1524] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:24.385764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee754c-27e4-4c13-b78b-df1cebef4433 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.419169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee754c-27e4-4c13-b78b-df1cebef4433 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.435999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0643b-e36c-4bc6-bb63-79ed84cc5438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.436993 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0643b-e36c-4bc6-bb63-79ed84cc5438 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.437438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0643b-e36c-4bc6-bb63-79ed84cc5438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.437881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0643b-e36c-4bc6-bb63-79ed84cc5438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.438758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0643b-e36c-4bc6-bb63-79ed84cc5438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.441128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0643b-e36c-4bc6-bb63-79ed84cc5438 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.462317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:DELETE=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:24.474089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 778/1525] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:24.474089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362062bb-b948-4628-9175-d32d9087339d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.474089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362062bb-b948-4628-9175-d32d9087339d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.474089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362062bb-b948-4628-9175-d32d9087339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.483953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a07e466a904e0db02607ad67e1ffc5', 'request_id': 'req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:24.496764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a07e466a904e0db02607ad67e1ffc5', 'request_id': 'req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:24.507523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a07e466a904e0db02607ad67e1ffc5', 'request_id': 'req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:24.526199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] The token cache is being invalidate because project b4a07e466a904e0db02607ad67e1ffc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:24.526470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:24.527167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:24.529948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 748/1526] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:24 2022] DELETE /identity/v3/projects/b4a07e466a904e0db02607ad67e1ffc5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:24.530837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.532411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.533398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-362062bb-b948-4628-9175-d32d9087339d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:24.534603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-362062bb-b948-4628-9175-d32d9087339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.643814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae4ce7-9241-4e00-8ba2-7c04d139ac20 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.652287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16b27-59d2-4b0e-b56d-d09fa92f245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.653467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16b27-59d2-4b0e-b56d-d09fa92f245e admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.653805 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16b27-59d2-4b0e-b56d-d09fa92f245e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.654078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16b27-59d2-4b0e-b56d-d09fa92f245e admin admin] PATH_INFO: `/v3/projects/e933d889fe2b427bad061443917ad1e4/users/c863246035634f03b82c152792b7471e/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.669063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 779/1527] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:24.670683 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362062bb-b948-4628-9175-d32d9087339d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.674015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-362062bb-b948-4628-9175-d32d9087339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.677309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16b27-59d2-4b0e-b56d-d09fa92f245e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e933d889fe2b427bad061443917ad1e4, user_id=c863246035634f03b82c152792b7471e, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.679928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16b27-59d2-4b0e-b56d-d09fa92f245e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.694472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362062bb-b948-4628-9175-d32d9087339d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.723702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 749/1528] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:24 2022] PUT /identity/v3/projects/e933d889fe2b427bad061443917ad1e4/users/c863246035634f03b82c152792b7471e/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:24.725053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98999a3-9d38-437d-8d77-2b061317a3c7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.725359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98999a3-9d38-437d-8d77-2b061317a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.725615 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98999a3-9d38-437d-8d77-2b061317a3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.756010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e98999a3-9d38-437d-8d77-2b061317a3c7 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:24.760772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e98999a3-9d38-437d-8d77-2b061317a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.787278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f027c-69b2-4ca2-b7a6-68ab449ffc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.787927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f027c-69b2-4ca2-b7a6-68ab449ffc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.788274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f027c-69b2-4ca2-b7a6-68ab449ffc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.788620 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f027c-69b2-4ca2-b7a6-68ab449ffc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.789408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f027c-69b2-4ca2-b7a6-68ab449ffc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.791236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f027c-69b2-4ca2-b7a6-68ab449ffc04 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.806560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 780/1529] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:24.806560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f027c-69b2-4ca2-b7a6-68ab449ffc04 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.819067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f027c-69b2-4ca2-b7a6-68ab449ffc04 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.823893 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a126d-5d2e-400a-8e6d-b9e1dc1816a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.824513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a126d-5d2e-400a-8e6d-b9e1dc1816a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.824789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a126d-5d2e-400a-8e6d-b9e1dc1816a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.825059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a126d-5d2e-400a-8e6d-b9e1dc1816a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.825718 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a126d-5d2e-400a-8e6d-b9e1dc1816a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:24.826019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a126d-5d2e-400a-8e6d-b9e1dc1816a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.827657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a126d-5d2e-400a-8e6d-b9e1dc1816a5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.842479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 781/1530] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:24.843477 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a126d-5d2e-400a-8e6d-b9e1dc1816a5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.853699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a126d-5d2e-400a-8e6d-b9e1dc1816a5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.858547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22472d-3e65-4212-bd5e-800d46434ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.859190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22472d-3e65-4212-bd5e-800d46434ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.859486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22472d-3e65-4212-bd5e-800d46434ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.859858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22472d-3e65-4212-bd5e-800d46434ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.860625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22472d-3e65-4212-bd5e-800d46434ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.862625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22472d-3e65-4212-bd5e-800d46434ac7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.867918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 750/1531] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:24.875234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 782/1532] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:24.876012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22472d-3e65-4212-bd5e-800d46434ac7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.878536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98999a3-9d38-437d-8d77-2b061317a3c7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.881561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:24.891450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98999a3-9d38-437d-8d77-2b061317a3c7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.896813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393eec-7bd6-4757-b537-3eeb30485f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.897606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393eec-7bd6-4757-b537-3eeb30485f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.898672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393eec-7bd6-4757-b537-3eeb30485f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.899140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393eec-7bd6-4757-b537-3eeb30485f0e admin admin] PATH_INFO: `/v3/projects/999e56a51231411e8e03e1b6de9267bc/users/fb3a8f7737e749dfa91513f811842953/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.903127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22472d-3e65-4212-bd5e-800d46434ac7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.911946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82181c3b-1d65-4218-a06f-8591004bed85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.912768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181c3b-1d65-4218-a06f-8591004bed85 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.913115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181c3b-1d65-4218-a06f-8591004bed85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.913491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181c3b-1d65-4218-a06f-8591004bed85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.914206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82181c3b-1d65-4218-a06f-8591004bed85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.916734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82181c3b-1d65-4218-a06f-8591004bed85 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.924117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393eec-7bd6-4757-b537-3eeb30485f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=999e56a51231411e8e03e1b6de9267bc, user_id=fb3a8f7737e749dfa91513f811842953, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.927572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393eec-7bd6-4757-b537-3eeb30485f0e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.942216 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 751/1533] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:24 2022] PUT /identity/v3/projects/999e56a51231411e8e03e1b6de9267bc/users/fb3a8f7737e749dfa91513f811842953/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:24.943655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08170b08-f129-4fa1-b2c7-e5c27862bc59 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.943938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08170b08-f129-4fa1-b2c7-e5c27862bc59 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.944215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08170b08-f129-4fa1-b2c7-e5c27862bc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.967472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 783/1534] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:24 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:24.967472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82181c3b-1d65-4218-a06f-8591004bed85 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.968109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-08170b08-f129-4fa1-b2c7-e5c27862bc59 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:24.968556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-08170b08-f129-4fa1-b2c7-e5c27862bc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.993600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:25.038100 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 752/1535] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:25.039498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba298c-1035-4d72-a7c1-5358ca95b626 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.039786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba298c-1035-4d72-a7c1-5358ca95b626 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.040059 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba298c-1035-4d72-a7c1-5358ca95b626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.046017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82181c3b-1d65-4218-a06f-8591004bed85 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.050981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f1baa-3eed-4f2f-bf2a-16ea70f46c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.051688 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f1baa-3eed-4f2f-bf2a-16ea70f46c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.051967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f1baa-3eed-4f2f-bf2a-16ea70f46c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.052241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f1baa-3eed-4f2f-bf2a-16ea70f46c75 admin admin] PATH_INFO: `/v3/projects/e933d889fe2b427bad061443917ad1e4/users/c863246035634f03b82c152792b7471e/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.054146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f1baa-3eed-4f2f-bf2a-16ea70f46c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e933d889fe2b427bad061443917ad1e4, user_id=c863246035634f03b82c152792b7471e, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.056812 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f1baa-3eed-4f2f-bf2a-16ea70f46c75 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.067271 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 784/1536] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:24 2022] PUT /identity/v3/projects/e933d889fe2b427bad061443917ad1e4/users/c863246035634f03b82c152792b7471e/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:25.067713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f0ba298c-1035-4d72-a7c1-5358ca95b626 None None] MFA Rules not processed for user `fb3a8f7737e749dfa91513f811842953`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:25.068062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f1baa-3eed-4f2f-bf2a-16ea70f46c75 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.068986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f0ba298c-1035-4d72-a7c1-5358ca95b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:25.133450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 753/1537] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:25.134375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba298c-1035-4d72-a7c1-5358ca95b626 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.142093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f1baa-3eed-4f2f-bf2a-16ea70f46c75 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.144422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba298c-1035-4d72-a7c1-5358ca95b626 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.147154 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a7b4-a056-4108-af66-71817a7ca944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.147809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a7b4-a056-4108-af66-71817a7ca944 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.148086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a7b4-a056-4108-af66-71817a7ca944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.148356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a7b4-a056-4108-af66-71817a7ca944 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.148994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a7b4-a056-4108-af66-71817a7ca944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.149311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f05c2-ac80-477b-b62b-0b57b2c05c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.149921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f05c2-ac80-477b-b62b-0b57b2c05c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.150208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f05c2-ac80-477b-b62b-0b57b2c05c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.150530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f05c2-ac80-477b-b62b-0b57b2c05c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.150928 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a7b4-a056-4108-af66-71817a7ca944 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.151225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f05c2-ac80-477b-b62b-0b57b2c05c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:25.151561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f05c2-ac80-477b-b62b-0b57b2c05c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.153203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f05c2-ac80-477b-b62b-0b57b2c05c1c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.165858 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 754/1538] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:25.167359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076b4bc-ee89-4707-8adf-74057d6759fe None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.167671 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076b4bc-ee89-4707-8adf-74057d6759fe None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.167969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076b4bc-ee89-4707-8adf-74057d6759fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.175611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 785/1539] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:25 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:25.176495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a7b4-a056-4108-af66-71817a7ca944 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.185877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a7b4-a056-4108-af66-71817a7ca944 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.190514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29332fa8-946f-4e0a-bfd7-49e5693ad292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.191159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29332fa8-946f-4e0a-bfd7-49e5693ad292 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.191621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29332fa8-946f-4e0a-bfd7-49e5693ad292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.191902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29332fa8-946f-4e0a-bfd7-49e5693ad292 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.193392 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29332fa8-946f-4e0a-bfd7-49e5693ad292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.195341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29332fa8-946f-4e0a-bfd7-49e5693ad292 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.199824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1076b4bc-ee89-4707-8adf-74057d6759fe None None] MFA Rules not processed for user `c863246035634f03b82c152792b7471e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:25.201028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1076b4bc-ee89-4707-8adf-74057d6759fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:25.223151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 786/1540] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:25 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:25.224045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29332fa8-946f-4e0a-bfd7-49e5693ad292 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.268003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:25.273668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 755/1541] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:25.274638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076b4bc-ee89-4707-8adf-74057d6759fe None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.284981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076b4bc-ee89-4707-8adf-74057d6759fe None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.287330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29332fa8-946f-4e0a-bfd7-49e5693ad292 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.289923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea225c-6886-4c12-ae8b-5c2cc549258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.290501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea225c-6886-4c12-ae8b-5c2cc549258c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.290819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea225c-6886-4c12-ae8b-5c2cc549258c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.291098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea225c-6886-4c12-ae8b-5c2cc549258c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.291760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea225c-6886-4c12-ae8b-5c2cc549258c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.292150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd63ca-eecc-4847-bf1e-708252a49a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.292771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd63ca-eecc-4847-bf1e-708252a49a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.293050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd63ca-eecc-4847-bf1e-708252a49a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.293324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd63ca-eecc-4847-bf1e-708252a49a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.293431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea225c-6886-4c12-ae8b-5c2cc549258c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.293956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd63ca-eecc-4847-bf1e-708252a49a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.295916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd63ca-eecc-4847-bf1e-708252a49a0a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.307420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 756/1542] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:25.307420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea225c-6886-4c12-ae8b-5c2cc549258c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.315637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea225c-6886-4c12-ae8b-5c2cc549258c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.320675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f271f-bcf4-4713-aa16-8939cb52b02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.321277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f271f-bcf4-4713-aa16-8939cb52b02b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.321561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f271f-bcf4-4713-aa16-8939cb52b02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.321838 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f271f-bcf4-4713-aa16-8939cb52b02b admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.325688 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 787/1543] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:25 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:25.325837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f271f-bcf4-4713-aa16-8939cb52b02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.325930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd63ca-eecc-4847-bf1e-708252a49a0a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.326023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f271f-bcf4-4713-aa16-8939cb52b02b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.327473 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9cbd63ca-eecc-4847-bf1e-708252a49a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:25.342464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:25.348774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 757/1544] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:25 2022] POST /identity/v3/users => generated 310 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:25.349583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f271f-bcf4-4713-aa16-8939cb52b02b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.362044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f271f-bcf4-4713-aa16-8939cb52b02b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.386658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd63ca-eecc-4847-bf1e-708252a49a0a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.390511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26dccf-ff74-4149-b928-f5b0bc4bfbcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.391194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26dccf-ff74-4149-b928-f5b0bc4bfbcc service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.391473 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26dccf-ff74-4149-b928-f5b0bc4bfbcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.391775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26dccf-ff74-4149-b928-f5b0bc4bfbcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.418525 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d471-b268-411a-987d-5685cbbf982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.419175 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d471-b268-411a-987d-5685cbbf982f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.419458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d471-b268-411a-987d-5685cbbf982f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.419732 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d471-b268-411a-987d-5685cbbf982f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.420377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d471-b268-411a-987d-5685cbbf982f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.422031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d471-b268-411a-987d-5685cbbf982f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.431810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 758/1545] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:25.432595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d471-b268-411a-987d-5685cbbf982f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.442496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d471-b268-411a-987d-5685cbbf982f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.447096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7f99-b30f-493f-ada3-c566e29f7434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.447687 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7f99-b30f-493f-ada3-c566e29f7434 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.447965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7f99-b30f-493f-ada3-c566e29f7434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.448242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7f99-b30f-493f-ada3-c566e29f7434 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.448859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b7f99-b30f-493f-ada3-c566e29f7434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.450811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b7f99-b30f-493f-ada3-c566e29f7434 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.452324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26dccf-ff74-4149-b928-f5b0bc4bfbcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.453778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26dccf-ff74-4149-b928-f5b0bc4bfbcc service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.463373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 788/1546] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:25.464202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26dccf-ff74-4149-b928-f5b0bc4bfbcc service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.476796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 759/1547] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:25 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:25.476966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26dccf-ff74-4149-b928-f5b0bc4bfbcc service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.477061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7f99-b30f-493f-ada3-c566e29f7434 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.481375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1a6ca-a552-42a2-bd96-635c4d1408e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.481998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1a6ca-a552-42a2-bd96-635c4d1408e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.482269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1a6ca-a552-42a2-bd96-635c4d1408e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.482539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1a6ca-a552-42a2-bd96-635c4d1408e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.483215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1a6ca-a552-42a2-bd96-635c4d1408e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.485009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1a6ca-a552-42a2-bd96-635c4d1408e6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.487868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7f99-b30f-493f-ada3-c566e29f7434 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.494038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8969e9-1e5e-4855-844c-762f6bb40849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.494757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8969e9-1e5e-4855-844c-762f6bb40849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.495171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8969e9-1e5e-4855-844c-762f6bb40849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.495340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8969e9-1e5e-4855-844c-762f6bb40849 admin admin] PATH_INFO: `/v3/projects/686de9ffff0a4810b2beeb2332996b35/users/f10cac91906047b4a478dad895f8cdb6/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.499622 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 789/1548] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:25.499622 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1a6ca-a552-42a2-bd96-635c4d1408e6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.512040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1a6ca-a552-42a2-bd96-635c4d1408e6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.516861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e89b55-473b-49da-b4e6-7ed95e28c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.517452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89b55-473b-49da-b4e6-7ed95e28c199 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.517734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89b55-473b-49da-b4e6-7ed95e28c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.518009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89b55-473b-49da-b4e6-7ed95e28c199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.518668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e89b55-473b-49da-b4e6-7ed95e28c199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.519404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8969e9-1e5e-4855-844c-762f6bb40849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686de9ffff0a4810b2beeb2332996b35, user_id=f10cac91906047b4a478dad895f8cdb6, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.520288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e89b55-473b-49da-b4e6-7ed95e28c199 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.522431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8969e9-1e5e-4855-844c-762f6bb40849 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.530869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 790/1549] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:25.531670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e89b55-473b-49da-b4e6-7ed95e28c199 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.541172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 760/1550] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:25 2022] PUT /identity/v3/projects/686de9ffff0a4810b2beeb2332996b35/users/f10cac91906047b4a478dad895f8cdb6/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:25.541466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e89b55-473b-49da-b4e6-7ed95e28c199 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.542356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8969e9-1e5e-4855-844c-762f6bb40849 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.605464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:25.615259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0368a-f29a-4a28-9202-c48fa0f4e365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.615957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0368a-f29a-4a28-9202-c48fa0f4e365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.616498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0368a-f29a-4a28-9202-c48fa0f4e365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.616781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0368a-f29a-4a28-9202-c48fa0f4e365 admin admin] PATH_INFO: `/v3/projects/b73956f488a241b996705fdf923f4e1d/users/33bf4a6d7889443b9ed79d2f39c61428/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.620073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8969e9-1e5e-4855-844c-762f6bb40849 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.625217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9ac27-6177-4882-a20c-8efcfb187ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.625979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9ac27-6177-4882-a20c-8efcfb187ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.626157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9ac27-6177-4882-a20c-8efcfb187ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.626433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9ac27-6177-4882-a20c-8efcfb187ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.627124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9ac27-6177-4882-a20c-8efcfb187ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.628726 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9ac27-6177-4882-a20c-8efcfb187ab3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.635343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0368a-f29a-4a28-9202-c48fa0f4e365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73956f488a241b996705fdf923f4e1d, user_id=33bf4a6d7889443b9ed79d2f39c61428, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.638286 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0368a-f29a-4a28-9202-c48fa0f4e365 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.638990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 761/1551] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:25.643857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb73187-520d-4757-857c-d1204f5fc404 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.644147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb73187-520d-4757-857c-d1204f5fc404 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.644552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb73187-520d-4757-857c-d1204f5fc404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.658948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 791/1552] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:25 2022] PUT /identity/v3/projects/b73956f488a241b996705fdf923f4e1d/users/33bf4a6d7889443b9ed79d2f39c61428/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:25.662920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0368a-f29a-4a28-9202-c48fa0f4e365 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.675774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8bb73187-520d-4757-857c-d1204f5fc404 None None] MFA Rules not processed for user `f10cac91906047b4a478dad895f8cdb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:25.677178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8bb73187-520d-4757-857c-d1204f5fc404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:25.730376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:25.744777 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0368a-f29a-4a28-9202-c48fa0f4e365 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:25.753352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d40f6-11ad-49b6-8fa7-9694c77fd450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:25.754289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d40f6-11ad-49b6-8fa7-9694c77fd450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.754866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d40f6-11ad-49b6-8fa7-9694c77fd450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.755146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d40f6-11ad-49b6-8fa7-9694c77fd450 admin admin] PATH_INFO: `/v3/projects/137eccecfecd43678935d14f2147e9ea/users/41c3f0992c0246eabbbc91c3dd1b19ef/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.778919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d40f6-11ad-49b6-8fa7-9694c77fd450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137eccecfecd43678935d14f2147e9ea, user_id=41c3f0992c0246eabbbc91c3dd1b19ef, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:25.782270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d40f6-11ad-49b6-8fa7-9694c77fd450 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:25.802941 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 792/1553] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:25 2022] PUT /identity/v3/projects/137eccecfecd43678935d14f2147e9ea/users/41c3f0992c0246eabbbc91c3dd1b19ef/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:25.804080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d40f6-11ad-49b6-8fa7-9694c77fd450 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:25.824523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 762/1554] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:25.828141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec018ca-c111-407b-9f58-dc5d27f63661 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:25.828141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec018ca-c111-407b-9f58-dc5d27f63661 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:25.828141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec018ca-c111-407b-9f58-dc5d27f63661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:25.877628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2ec018ca-c111-407b-9f58-dc5d27f63661 None None] MFA Rules not processed for user `41c3f0992c0246eabbbc91c3dd1b19ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:25.878916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2ec018ca-c111-407b-9f58-dc5d27f63661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:26.061459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 763/1555] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:26.061876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec018ca-c111-407b-9f58-dc5d27f63661 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.115662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d40f6-11ad-49b6-8fa7-9694c77fd450 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.125841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fd1c6-0559-4ec8-94a0-9e8c93e52280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.126664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd1c6-0559-4ec8-94a0-9e8c93e52280 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.126975 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd1c6-0559-4ec8-94a0-9e8c93e52280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.127251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd1c6-0559-4ec8-94a0-9e8c93e52280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.127908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fd1c6-0559-4ec8-94a0-9e8c93e52280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.131650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fd1c6-0559-4ec8-94a0-9e8c93e52280 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.146794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 793/1556] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:26.146794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fd1c6-0559-4ec8-94a0-9e8c93e52280 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.147266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec018ca-c111-407b-9f58-dc5d27f63661 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.156873 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd776458-08fd-4376-84b9-c9b9154d8c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.158122 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd776458-08fd-4376-84b9-c9b9154d8c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.158480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd776458-08fd-4376-84b9-c9b9154d8c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.158855 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd776458-08fd-4376-84b9-c9b9154d8c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.159723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd776458-08fd-4376-84b9-c9b9154d8c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.160188 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fd1c6-0559-4ec8-94a0-9e8c93e52280 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.165114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.165878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.166159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.166432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] PATH_INFO: `/v3/users/da93021faf554a1fbae05e2d9d3e0e00` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.168061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd776458-08fd-4376-84b9-c9b9154d8c8c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.168531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da93021faf554a1fbae05e2d9d3e0e00)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.172591 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.209504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 764/1557] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:26 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:26.211564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd776458-08fd-4376-84b9-c9b9154d8c8c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.235222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da93021faf554a1fbae05e2d9d3e0e00'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:26.247438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da93021faf554a1fbae05e2d9d3e0e00'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:26.255378 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:26.265433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da93021faf554a1fbae05e2d9d3e0e00'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:26.266860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da93021faf554a1fbae05e2d9d3e0e00'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:26.303216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da93021faf554a1fbae05e2d9d3e0e00'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:26.312593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 794/1558] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:26 2022] DELETE /identity/v3/users/da93021faf554a1fbae05e2d9d3e0e00 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:26.313669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.315438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:26.321847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd776458-08fd-4376-84b9-c9b9154d8c8c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.331677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:26.402092 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f75927-3698-428c-a73d-9d234cbd0bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.402802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f75927-3698-428c-a73d-9d234cbd0bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.403048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f75927-3698-428c-a73d-9d234cbd0bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.403325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f75927-3698-428c-a73d-9d234cbd0bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.405102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-19f75927-3698-428c-a73d-9d234cbd0bc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:26.407052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378405d-e963-48aa-ba50-6600e80cdfb8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.411891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055ce5-d402-417c-9b22-f8b60d00b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.412666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055ce5-d402-417c-9b22-f8b60d00b401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.413003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055ce5-d402-417c-9b22-f8b60d00b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.413337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055ce5-d402-417c-9b22-f8b60d00b401 admin admin] PATH_INFO: `/v3/projects/b73956f488a241b996705fdf923f4e1d/users/33bf4a6d7889443b9ed79d2f39c61428/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.415365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb055ce5-d402-417c-9b22-f8b60d00b401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73956f488a241b996705fdf923f4e1d, user_id=33bf4a6d7889443b9ed79d2f39c61428, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.418080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb055ce5-d402-417c-9b22-f8b60d00b401 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.431540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 795/1559] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:26 2022] PUT /identity/v3/projects/b73956f488a241b996705fdf923f4e1d/users/33bf4a6d7889443b9ed79d2f39c61428/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:26.432394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055ce5-d402-417c-9b22-f8b60d00b401 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.434237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cb055ce5-d402-417c-9b22-f8b60d00b401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:26.478208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f75927-3698-428c-a73d-9d234cbd0bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.479962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f75927-3698-428c-a73d-9d234cbd0bc9 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.489988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 765/1560] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:26.491325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069fb0-9d9e-445b-be42-8606f60c212d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.491617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069fb0-9d9e-445b-be42-8606f60c212d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.491891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069fb0-9d9e-445b-be42-8606f60c212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.513951 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-55069fb0-9d9e-445b-be42-8606f60c212d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:26.515331 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-55069fb0-9d9e-445b-be42-8606f60c212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:26.530579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 766/1561] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:26.533403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103104b-a593-4f0a-b39c-f21d2ddc8bf3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.533761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103104b-a593-4f0a-b39c-f21d2ddc8bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.534210 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103104b-a593-4f0a-b39c-f21d2ddc8bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.537185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055ce5-d402-417c-9b22-f8b60d00b401 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.546156 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb960027-8adf-4dc7-9aac-7e8fea5faead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.548932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb960027-8adf-4dc7-9aac-7e8fea5faead admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.549391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb960027-8adf-4dc7-9aac-7e8fea5faead admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.549671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb960027-8adf-4dc7-9aac-7e8fea5faead admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.557372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb960027-8adf-4dc7-9aac-7e8fea5faead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.557372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb960027-8adf-4dc7-9aac-7e8fea5faead admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.590059 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b103104b-a593-4f0a-b39c-f21d2ddc8bf3 None None] MFA Rules not processed for user `33bf4a6d7889443b9ed79d2f39c61428`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:26.593855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 796/1562] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:26 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:26.593855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb960027-8adf-4dc7-9aac-7e8fea5faead admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.594065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b103104b-a593-4f0a-b39c-f21d2ddc8bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:26.595007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eb960027-8adf-4dc7-9aac-7e8fea5faead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:26.665082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb960027-8adf-4dc7-9aac-7e8fea5faead admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.670117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfea53-747b-4490-a2d3-08b82ca2f4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.671087 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfea53-747b-4490-a2d3-08b82ca2f4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.671956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfea53-747b-4490-a2d3-08b82ca2f4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.672584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfea53-747b-4490-a2d3-08b82ca2f4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.684690 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:26.688694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfea53-747b-4490-a2d3-08b82ca2f4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.690662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfea53-747b-4490-a2d3-08b82ca2f4d0 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.703644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 767/1563] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:26 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:26.704832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103104b-a593-4f0a-b39c-f21d2ddc8bf3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.705966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 797/1564] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:26.718535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfea53-747b-4490-a2d3-08b82ca2f4d0 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.720422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-12dfea53-747b-4490-a2d3-08b82ca2f4d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:26.734466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103104b-a593-4f0a-b39c-f21d2ddc8bf3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.741062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f38051-ef39-43b1-a2af-6473a92acc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.742003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f38051-ef39-43b1-a2af-6473a92acc85 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.742549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f38051-ef39-43b1-a2af-6473a92acc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.743078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f38051-ef39-43b1-a2af-6473a92acc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.743888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f38051-ef39-43b1-a2af-6473a92acc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.745994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f38051-ef39-43b1-a2af-6473a92acc85 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.763049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 768/1565] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:26.773908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f38051-ef39-43b1-a2af-6473a92acc85 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.789382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f38051-ef39-43b1-a2af-6473a92acc85 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.797748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf95719-473f-4a19-9e63-8139816cde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.798825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95719-473f-4a19-9e63-8139816cde8a admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.800355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95719-473f-4a19-9e63-8139816cde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.801256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95719-473f-4a19-9e63-8139816cde8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.802310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf95719-473f-4a19-9e63-8139816cde8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.805078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf95719-473f-4a19-9e63-8139816cde8a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.821198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 769/1566] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:26.825184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf95719-473f-4a19-9e63-8139816cde8a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:26.838192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf95719-473f-4a19-9e63-8139816cde8a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.851812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cc7b5-25e0-49f5-aad2-24e092354259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.854485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc7b5-25e0-49f5-aad2-24e092354259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.854941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc7b5-25e0-49f5-aad2-24e092354259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.855374 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc7b5-25e0-49f5-aad2-24e092354259 admin admin] PATH_INFO: `/v3/projects/e828a97582d348dfaea0aab319c764fc/users/63a5ba591cc84ffea5d31f363ac11cda/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.892096 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfea53-747b-4490-a2d3-08b82ca2f4d0 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:26.908585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892361-eca8-4bb9-99a6-27a799bb4999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:26.909069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cc7b5-25e0-49f5-aad2-24e092354259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e828a97582d348dfaea0aab319c764fc, user_id=63a5ba591cc84ffea5d31f363ac11cda, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.909653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892361-eca8-4bb9-99a6-27a799bb4999 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.910114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892361-eca8-4bb9-99a6-27a799bb4999 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.910551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892361-eca8-4bb9-99a6-27a799bb4999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:26.918002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cc7b5-25e0-49f5-aad2-24e092354259 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.938001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f892361-eca8-4bb9-99a6-27a799bb4999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:26.940425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f892361-eca8-4bb9-99a6-27a799bb4999 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:26.942333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:26.953945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 770/1567] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:26 2022] PUT /identity/v3/projects/e828a97582d348dfaea0aab319c764fc/users/63a5ba591cc84ffea5d31f363ac11cda/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:26.967562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a68439-5b4b-49e9-ad2a-4f263d4b802b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:26.968055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a68439-5b4b-49e9-ad2a-4f263d4b802b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:26.968182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a68439-5b4b-49e9-ad2a-4f263d4b802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:27.000498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 798/1568] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:26 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:27.024470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-87a68439-5b4b-49e9-ad2a-4f263d4b802b None None] MFA Rules not processed for user `63a5ba591cc84ffea5d31f363ac11cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:27.028138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-87a68439-5b4b-49e9-ad2a-4f263d4b802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:27.233212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 771/1569] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:27.237826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892361-eca8-4bb9-99a6-27a799bb4999 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:27.254261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892361-eca8-4bb9-99a6-27a799bb4999 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:27.337982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a68439-5b4b-49e9-ad2a-4f263d4b802b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:27.340114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-87a68439-5b4b-49e9-ad2a-4f263d4b802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:27.379279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae43e-6bee-45f5-aaf1-82d3d3fa7ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:27.380278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae43e-6bee-45f5-aaf1-82d3d3fa7ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:27.380754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae43e-6bee-45f5-aaf1-82d3d3fa7ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:27.381241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae43e-6bee-45f5-aaf1-82d3d3fa7ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:27.382077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae43e-6bee-45f5-aaf1-82d3d3fa7ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:27.397808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae43e-6bee-45f5-aaf1-82d3d3fa7ee3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:27.448953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 799/1570] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:27 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:27.450325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae43e-6bee-45f5-aaf1-82d3d3fa7ee3 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:27.458843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a68439-5b4b-49e9-ad2a-4f263d4b802b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:27.540609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f836d52-feb0-4f75-ad47-ad2215ba89b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:27.541999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f836d52-feb0-4f75-ad47-ad2215ba89b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:27.542492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f836d52-feb0-4f75-ad47-ad2215ba89b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:27.542981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f836d52-feb0-4f75-ad47-ad2215ba89b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:27.544696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae43e-6bee-45f5-aaf1-82d3d3fa7ee3 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:27.546143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6f836d52-feb0-4f75-ad47-ad2215ba89b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:27.551524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e118-d9be-456b-85f2-0d8b4597d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:27.552008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e118-d9be-456b-85f2-0d8b4597d879 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:27.552383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e118-d9be-456b-85f2-0d8b4597d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:27.552752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e118-d9be-456b-85f2-0d8b4597d879 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:27.553526 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e118-d9be-456b-85f2-0d8b4597d879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:27.555849 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8e118-d9be-456b-85f2-0d8b4597d879 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:27.590359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 800/1571] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:27 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:27.594253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e118-d9be-456b-85f2-0d8b4597d879 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:27.615283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e118-d9be-456b-85f2-0d8b4597d879 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:27.627626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7aaef-8466-434b-bc83-debdc365a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:27.629384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7aaef-8466-434b-bc83-debdc365a722 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:27.629835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7aaef-8466-434b-bc83-debdc365a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:27.630349 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7aaef-8466-434b-bc83-debdc365a722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:27.632086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7aaef-8466-434b-bc83-debdc365a722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:27.635884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7aaef-8466-434b-bc83-debdc365a722 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:27.636049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f836d52-feb0-4f75-ad47-ad2215ba89b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:27.638302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f836d52-feb0-4f75-ad47-ad2215ba89b3 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:27.642342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:27.655369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 801/1572] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:27.656045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 772/1573] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:27 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:27.671775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7aaef-8466-434b-bc83-debdc365a722 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:27.681001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:27.689560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7aaef-8466-434b-bc83-debdc365a722 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:27.698182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77952d32-e8a6-493d-8594-c835fddc3a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:27.698900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77952d32-e8a6-493d-8594-c835fddc3a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:27.699540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77952d32-e8a6-493d-8594-c835fddc3a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:27.701114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77952d32-e8a6-493d-8594-c835fddc3a25 admin admin] PATH_INFO: `/v3/projects/f52911dea53b4acbbd8cc9b58c359016/users/d892c80fd07b41afa6c6a54502e90407/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:27.757880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77952d32-e8a6-493d-8594-c835fddc3a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52911dea53b4acbbd8cc9b58c359016, user_id=d892c80fd07b41afa6c6a54502e90407, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:27.760723 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77952d32-e8a6-493d-8594-c835fddc3a25 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:27.808305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 802/1574] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:27 2022] PUT /identity/v3/projects/f52911dea53b4acbbd8cc9b58c359016/users/d892c80fd07b41afa6c6a54502e90407/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:27.812342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f836d52-feb0-4f75-ad47-ad2215ba89b3 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:27.827801 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f836d52-feb0-4f75-ad47-ad2215ba89b3 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:27.922136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62218e87-bbad-4f8c-8984-948b63349462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:27.923007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62218e87-bbad-4f8c-8984-948b63349462 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:27.923393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62218e87-bbad-4f8c-8984-948b63349462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:27.923797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62218e87-bbad-4f8c-8984-948b63349462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:27.924747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62218e87-bbad-4f8c-8984-948b63349462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:27.927444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62218e87-bbad-4f8c-8984-948b63349462 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:27.941466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 773/1575] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:27.946231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77952d32-e8a6-493d-8594-c835fddc3a25 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:27.964420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77952d32-e8a6-493d-8594-c835fddc3a25 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:27.970216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f4b5b-f157-4911-81df-bfa758d9b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:27.971550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4b5b-f157-4911-81df-bfa758d9b0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:27.971839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4b5b-f157-4911-81df-bfa758d9b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:27.972483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4b5b-f157-4911-81df-bfa758d9b0a5 admin admin] PATH_INFO: `/v3/projects/f52911dea53b4acbbd8cc9b58c359016/users/d892c80fd07b41afa6c6a54502e90407/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:27.986446 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f4b5b-f157-4911-81df-bfa758d9b0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52911dea53b4acbbd8cc9b58c359016, user_id=d892c80fd07b41afa6c6a54502e90407, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:27.989396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f4b5b-f157-4911-81df-bfa758d9b0a5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:28.007144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62218e87-bbad-4f8c-8984-948b63349462 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:28.010113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-62218e87-bbad-4f8c-8984-948b63349462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:28.033378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62218e87-bbad-4f8c-8984-948b63349462 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:28.039057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 803/1576] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:27 2022] PUT /identity/v3/projects/f52911dea53b4acbbd8cc9b58c359016/users/d892c80fd07b41afa6c6a54502e90407/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:28.043911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c3db0-9e95-40e9-9fd7-1833e95b319a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:28.044205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c3db0-9e95-40e9-9fd7-1833e95b319a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:28.044634 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c3db0-9e95-40e9-9fd7-1833e95b319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:28.077048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-694c3db0-9e95-40e9-9fd7-1833e95b319a None None] MFA Rules not processed for user `d892c80fd07b41afa6c6a54502e90407`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:28.078372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-694c3db0-9e95-40e9-9fd7-1833e95b319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:28.125213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:28.126159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:28.126443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:28.126744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] PATH_INFO: `/v3/projects/288513a6ce944412b7bb189c138c806b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:28.128049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=288513a6ce944412b7bb189c138c806b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:28.129979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:28.208785 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288513a6ce944412b7bb189c138c806b', 'request_id': 'req-b09a0f6c-9d77-4355-8458-f3b539afe367'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.224563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288513a6ce944412b7bb189c138c806b', 'request_id': 'req-b09a0f6c-9d77-4355-8458-f3b539afe367'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.225925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 804/1577] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:28.233994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288513a6ce944412b7bb189c138c806b', 'request_id': 'req-b09a0f6c-9d77-4355-8458-f3b539afe367'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.255757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c3db0-9e95-40e9-9fd7-1833e95b319a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:28.259464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] The token cache is being invalidate because project 288513a6ce944412b7bb189c138c806b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:28.259816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.263191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.264912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 774/1578] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:28 2022] DELETE /identity/v3/projects/288513a6ce944412b7bb189c138c806b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:28.268648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:28.272643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:28.324143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:28.363292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c3db0-9e95-40e9-9fd7-1833e95b319a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:28.390017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a0f6c-9d77-4355-8458-f3b539afe367 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:28.395523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:28.396188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:28.396737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:28.396927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] PATH_INFO: `/v3/users/c863246035634f03b82c152792b7471e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:28.398228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c863246035634f03b82c152792b7471e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:28.400428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:28.465699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9f2ba-c5e6-48e7-baf8-e351e42ebb4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:28.466747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9f2ba-c5e6-48e7-baf8-e351e42ebb4a service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:28.467175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9f2ba-c5e6-48e7-baf8-e351e42ebb4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:28.468496 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9f2ba-c5e6-48e7-baf8-e351e42ebb4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:28.470417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-96c9f2ba-c5e6-48e7-baf8-e351e42ebb4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:28.474255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c863246035634f03b82c152792b7471e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.483267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c863246035634f03b82c152792b7471e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.496611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c863246035634f03b82c152792b7471e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.497288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:28.506984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c863246035634f03b82c152792b7471e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.508097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c863246035634f03b82c152792b7471e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:28.515179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 775/1579] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:28 2022] DELETE /identity/v3/users/c863246035634f03b82c152792b7471e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:28.550059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9f2ba-c5e6-48e7-baf8-e351e42ebb4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:28.551616 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9f2ba-c5e6-48e7-baf8-e351e42ebb4a service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:28.563369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 805/1580] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:28.618251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:28.620244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:28.721610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc63db-1553-469e-9b33-e2431f4ed1a5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:28.732649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9fc21-2971-4227-9e84-7028d1de31f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:28.733645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9fc21-2971-4227-9e84-7028d1de31f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:28.734059 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9fc21-2971-4227-9e84-7028d1de31f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:28.734474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9fc21-2971-4227-9e84-7028d1de31f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:28.737911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fca9fc21-2971-4227-9e84-7028d1de31f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:28.864763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9fc21-2971-4227-9e84-7028d1de31f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:28.867273 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9fc21-2971-4227-9e84-7028d1de31f0 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:28.872449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:28.896437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 776/1581] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:29.913064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9f2ba-c5e6-48e7-baf8-e351e42ebb4a service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:29.970779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9f2ba-c5e6-48e7-baf8-e351e42ebb4a service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:30.115832 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:30.116562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:30.117227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:30.117616 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] PATH_INFO: `/v3/projects/e933d889fe2b427bad061443917ad1e4` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:30.119139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e933d889fe2b427bad061443917ad1e4)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:30.121524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:30.245549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e933d889fe2b427bad061443917ad1e4', 'request_id': 'req-67352776-1632-4685-b37b-607580982dc0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.253419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e933d889fe2b427bad061443917ad1e4', 'request_id': 'req-67352776-1632-4685-b37b-607580982dc0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.263307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e933d889fe2b427bad061443917ad1e4', 'request_id': 'req-67352776-1632-4685-b37b-607580982dc0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.286515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] The token cache is being invalidate because project e933d889fe2b427bad061443917ad1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:30.287431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.288455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.291676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 806/1582] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:29 2022] DELETE /identity/v3/projects/e933d889fe2b427bad061443917ad1e4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:30.311674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e9f02-772b-46b1-9561-28baad2960bd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:30.312238 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e9f02-772b-46b1-9561-28baad2960bd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:30.312238 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e9f02-772b-46b1-9561-28baad2960bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:30.342161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-230e9f02-772b-46b1-9561-28baad2960bd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:30.343616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-230e9f02-772b-46b1-9561-28baad2960bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:30.425335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:30.427110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:30.455661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 777/1583] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:30.464312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adfe7a-34df-4d6f-9fa1-f38228c198d6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:30.464915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adfe7a-34df-4d6f-9fa1-f38228c198d6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:30.466794 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adfe7a-34df-4d6f-9fa1-f38228c198d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:30.494494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-59adfe7a-34df-4d6f-9fa1-f38228c198d6 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:30.494660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:30.495774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-59adfe7a-34df-4d6f-9fa1-f38228c198d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:30.504939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 778/1584] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:30.510148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adfe7a-34df-4d6f-9fa1-f38228c198d6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:30.514891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352776-1632-4685-b37b-607580982dc0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:30.521175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:30.521503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adfe7a-34df-4d6f-9fa1-f38228c198d6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:30.522247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:30.522671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:30.523125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] PATH_INFO: `/v3/users/41c3f0992c0246eabbbc91c3dd1b19ef` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:30.524523 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c3f0992c0246eabbbc91c3dd1b19ef)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:30.526857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:30.529334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ba849-d2e1-450c-ad4f-64d39699aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:30.530138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ba849-d2e1-450c-ad4f-64d39699aead admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:30.530574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ba849-d2e1-450c-ad4f-64d39699aead admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:30.530879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ba849-d2e1-450c-ad4f-64d39699aead admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:30.531536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ba849-d2e1-450c-ad4f-64d39699aead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:30.531835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ba849-d2e1-450c-ad4f-64d39699aead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:30.533721 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ba849-d2e1-450c-ad4f-64d39699aead admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:30.553399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 779/1585] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:30.554601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ba849-d2e1-450c-ad4f-64d39699aead admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:30.568550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ba849-d2e1-450c-ad4f-64d39699aead admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:30.573726 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8d854-85e9-4045-8d24-5ddb4ccac80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:30.574459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d854-85e9-4045-8d24-5ddb4ccac80d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:30.574736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d854-85e9-4045-8d24-5ddb4ccac80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:30.575462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d854-85e9-4045-8d24-5ddb4ccac80d admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:30.575780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8d854-85e9-4045-8d24-5ddb4ccac80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:30.577993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8d854-85e9-4045-8d24-5ddb4ccac80d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:30.609371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c3f0992c0246eabbbc91c3dd1b19ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.624378 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c3f0992c0246eabbbc91c3dd1b19ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.626345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 780/1586] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:30 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:30.631594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8d854-85e9-4045-8d24-5ddb4ccac80d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:30.633172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c3f0992c0246eabbbc91c3dd1b19ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.633980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c3f0992c0246eabbbc91c3dd1b19ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.656857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a386dd5d-3dab-4b50-b7d1-c95fcf69efb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c3f0992c0246eabbbc91c3dd1b19ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:30.672229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 807/1587] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:30 2022] DELETE /identity/v3/users/41c3f0992c0246eabbbc91c3dd1b19ef => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:30.677572 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9e05c-5083-41bc-9a74-ba3926fab2d2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:30.677849 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9e05c-5083-41bc-9a74-ba3926fab2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:30.678126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9e05c-5083-41bc-9a74-ba3926fab2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:30.718702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2ec9e05c-5083-41bc-9a74-ba3926fab2d2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:30.718702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2ec9e05c-5083-41bc-9a74-ba3926fab2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:30.741170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8d854-85e9-4045-8d24-5ddb4ccac80d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:30.866917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 808/1588] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:30.878628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9e05c-5083-41bc-9a74-ba3926fab2d2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:30.881054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2ec9e05c-5083-41bc-9a74-ba3926fab2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:30.889296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b6a97-8cb6-4ecf-bca8-622ce750e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:30.889464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b6a97-8cb6-4ecf-bca8-622ce750e6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:30.889690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b6a97-8cb6-4ecf-bca8-622ce750e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:30.889966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b6a97-8cb6-4ecf-bca8-622ce750e6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:30.890626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b6a97-8cb6-4ecf-bca8-622ce750e6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:30.896499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b6a97-8cb6-4ecf-bca8-622ce750e6b5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:30.928048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:30.952467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 781/1589] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:30 2022] POST /identity/v3/users => generated 282 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:30.957225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b6a97-8cb6-4ecf-bca8-622ce750e6b5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:30.965660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e69b6a97-8cb6-4ecf-bca8-622ce750e6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:31.012800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b6a97-8cb6-4ecf-bca8-622ce750e6b5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:31.028601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ade6a5-559c-43dd-aa30-ffc1b4b88f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:31.032703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ade6a5-559c-43dd-aa30-ffc1b4b88f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.033387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ade6a5-559c-43dd-aa30-ffc1b4b88f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.034550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ade6a5-559c-43dd-aa30-ffc1b4b88f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.036350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ade6a5-559c-43dd-aa30-ffc1b4b88f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:31.041323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ade6a5-559c-43dd-aa30-ffc1b4b88f9b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:31.067292 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 782/1590] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:31.069630 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9e05c-5083-41bc-9a74-ba3926fab2d2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:31.072115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ade6a5-559c-43dd-aa30-ffc1b4b88f9b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:31.080422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec8be7-2c9e-419f-8d3a-9a8f17f793c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:31.081079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec8be7-2c9e-419f-8d3a-9a8f17f793c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.081358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec8be7-2c9e-419f-8d3a-9a8f17f793c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.081635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec8be7-2c9e-419f-8d3a-9a8f17f793c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.098108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec8be7-2c9e-419f-8d3a-9a8f17f793c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:31.100205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec8be7-2c9e-419f-8d3a-9a8f17f793c9 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:31.100979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ade6a5-559c-43dd-aa30-ffc1b4b88f9b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:31.120469 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 809/1591] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:31.121514 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bcf88-a179-4f39-ad52-a06dd0644935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:31.122786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bcf88-a179-4f39-ad52-a06dd0644935 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.123255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bcf88-a179-4f39-ad52-a06dd0644935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.124078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bcf88-a179-4f39-ad52-a06dd0644935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.124877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bcf88-a179-4f39-ad52-a06dd0644935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:31.126922 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bcf88-a179-4f39-ad52-a06dd0644935 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:31.142445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 783/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:31.146515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec8be7-2c9e-419f-8d3a-9a8f17f793c9 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:31.162630 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec8be7-2c9e-419f-8d3a-9a8f17f793c9 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:31.191941 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d771c5-f289-4b9d-80ba-7fa38da10d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:31.193594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d771c5-f289-4b9d-80ba-7fa38da10d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.193825 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d771c5-f289-4b9d-80ba-7fa38da10d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.195798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d771c5-f289-4b9d-80ba-7fa38da10d5b admin admin] PATH_INFO: `/v3/projects/a8f3116d14734d7b864aca3f8b129c7b/users/3cfa80e7838848bc923bdbdda1762b9a/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.207457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:31.233229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d771c5-f289-4b9d-80ba-7fa38da10d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f3116d14734d7b864aca3f8b129c7b, user_id=3cfa80e7838848bc923bdbdda1762b9a, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:31.236917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d771c5-f289-4b9d-80ba-7fa38da10d5b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:31.278182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 810/1593] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:31 2022] PUT /identity/v3/projects/a8f3116d14734d7b864aca3f8b129c7b/users/3cfa80e7838848bc923bdbdda1762b9a/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:31.291590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2f017-0450-4051-b554-3e43abf1156f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.292961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2f017-0450-4051-b554-3e43abf1156f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.294379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2f017-0450-4051-b554-3e43abf1156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.354257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-14a2f017-0450-4051-b554-3e43abf1156f None None] MFA Rules not processed for user `3cfa80e7838848bc923bdbdda1762b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:31.358630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-14a2f017-0450-4051-b554-3e43abf1156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:31.512368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d771c5-f289-4b9d-80ba-7fa38da10d5b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:31.538647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 784/1594] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:31.634024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d771c5-f289-4b9d-80ba-7fa38da10d5b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:31.640252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fc560-8b8c-46c2-9392-e1270ce5f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:31.640252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fc560-8b8c-46c2-9392-e1270ce5f6eb admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.640482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fc560-8b8c-46c2-9392-e1270ce5f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.642751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fc560-8b8c-46c2-9392-e1270ce5f6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.643540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fc560-8b8c-46c2-9392-e1270ce5f6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:31.645617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fc560-8b8c-46c2-9392-e1270ce5f6eb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:31.682797 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 811/1595] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:31 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:31.685609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2f017-0450-4051-b554-3e43abf1156f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:31.697689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2f017-0450-4051-b554-3e43abf1156f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:31.827846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5dd3-2bc1-4803-aec5-5ac6cbb5c272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:31.852105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5dd3-2bc1-4803-aec5-5ac6cbb5c272 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.852574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5dd3-2bc1-4803-aec5-5ac6cbb5c272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.853031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5dd3-2bc1-4803-aec5-5ac6cbb5c272 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.853783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c5dd3-2bc1-4803-aec5-5ac6cbb5c272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:31.856505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c5dd3-2bc1-4803-aec5-5ac6cbb5c272 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:31.896792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7296-3942-4a86-bd76-197cde32a742 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.897177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7296-3942-4a86-bd76-197cde32a742 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.897528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b7296-3942-4a86-bd76-197cde32a742 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.899162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 812/1596] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:24:31.901606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 785/1597] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:31 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:31.906801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7296-3942-4a86-bd76-197cde32a742 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:31.920021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efaaf1-254c-4ec6-9a1c-925262ee1692 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.920774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efaaf1-254c-4ec6-9a1c-925262ee1692 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.921058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efaaf1-254c-4ec6-9a1c-925262ee1692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.924413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b7296-3942-4a86-bd76-197cde32a742 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:31.935122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286d241-8004-40b8-88fd-9a6e11e3af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:31.938868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286d241-8004-40b8-88fd-9a6e11e3af35 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.939289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286d241-8004-40b8-88fd-9a6e11e3af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.940351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286d241-8004-40b8-88fd-9a6e11e3af35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.943077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286d241-8004-40b8-88fd-9a6e11e3af35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:31.949261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286d241-8004-40b8-88fd-9a6e11e3af35 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:31.961393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f5efaaf1-254c-4ec6-9a1c-925262ee1692 None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:31.963344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f5efaaf1-254c-4ec6-9a1c-925262ee1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:31.993754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 813/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:31.995581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286d241-8004-40b8-88fd-9a6e11e3af35 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:32.005061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0286d241-8004-40b8-88fd-9a6e11e3af35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:32.030831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286d241-8004-40b8-88fd-9a6e11e3af35 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:32.042915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:32.045575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:32.050168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.052183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.053316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] PATH_INFO: `/v3/projects/137eccecfecd43678935d14f2147e9ea` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.063142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137eccecfecd43678935d14f2147e9ea)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:32.065206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:32.080297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 786/1599] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:32.081293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efaaf1-254c-4ec6-9a1c-925262ee1692 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:32.097456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efaaf1-254c-4ec6-9a1c-925262ee1692 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:32.102592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b72b-f8b3-4b9f-8bf8-74112e1688c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:32.103427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b72b-f8b3-4b9f-8bf8-74112e1688c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.104475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b72b-f8b3-4b9f-8bf8-74112e1688c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.104862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b72b-f8b3-4b9f-8bf8-74112e1688c9 admin admin] PATH_INFO: `/v3/projects/3e6463074f1d47738a1aed866d960819/users/a34c0823c36d43fdbe929f7b3d59c74f/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.127400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95b72b-f8b3-4b9f-8bf8-74112e1688c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6463074f1d47738a1aed866d960819, user_id=a34c0823c36d43fdbe929f7b3d59c74f, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:32.132274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95b72b-f8b3-4b9f-8bf8-74112e1688c9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:32.154503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 787/1600] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:32 2022] PUT /identity/v3/projects/3e6463074f1d47738a1aed866d960819/users/a34c0823c36d43fdbe929f7b3d59c74f/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:32.156246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b72b-f8b3-4b9f-8bf8-74112e1688c9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:32.158701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1a95b72b-f8b3-4b9f-8bf8-74112e1688c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:32.166790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137eccecfecd43678935d14f2147e9ea', 'request_id': 'req-86ce8363-d6ea-4a65-88f9-9391e1db5f98'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:32.175010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137eccecfecd43678935d14f2147e9ea', 'request_id': 'req-86ce8363-d6ea-4a65-88f9-9391e1db5f98'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:32.183526 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137eccecfecd43678935d14f2147e9ea', 'request_id': 'req-86ce8363-d6ea-4a65-88f9-9391e1db5f98'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:32.207816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] The token cache is being invalidate because project 137eccecfecd43678935d14f2147e9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:32.208517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:32.209452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:32.216312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 814/1601] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:31 2022] DELETE /identity/v3/projects/137eccecfecd43678935d14f2147e9ea => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:32.216312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:32.219913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:32.278093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b72b-f8b3-4b9f-8bf8-74112e1688c9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:32.284688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404231b0-163d-4c41-9d28-693d3f04627f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:32.285409 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404231b0-163d-4c41-9d28-693d3f04627f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.285755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404231b0-163d-4c41-9d28-693d3f04627f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.286112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404231b0-163d-4c41-9d28-693d3f04627f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.288145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-404231b0-163d-4c41-9d28-693d3f04627f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:32.289325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:32.304823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404231b0-163d-4c41-9d28-693d3f04627f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:32.307314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404231b0-163d-4c41-9d28-693d3f04627f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:32.317626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce8363-d6ea-4a65-88f9-9391e1db5f98 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:32.323404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 788/1602] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:32.325336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad75f-9ecc-46bf-97c2-21b485290ab5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.325843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad75f-9ecc-46bf-97c2-21b485290ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.326326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad75f-9ecc-46bf-97c2-21b485290ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.356195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0bcad75f-9ecc-46bf-97c2-21b485290ab5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:32.357432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0bcad75f-9ecc-46bf-97c2-21b485290ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:32.395998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652615f9-a133-4d69-b986-54f28fff542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:32.396643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652615f9-a133-4d69-b986-54f28fff542b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.396927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652615f9-a133-4d69-b986-54f28fff542b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.397202 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652615f9-a133-4d69-b986-54f28fff542b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.397926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652615f9-a133-4d69-b986-54f28fff542b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:32.399725 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652615f9-a133-4d69-b986-54f28fff542b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:32.411426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 815/1603] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:32.415714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652615f9-a133-4d69-b986-54f28fff542b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:32.429729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652615f9-a133-4d69-b986-54f28fff542b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:32.435480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203fa77-868d-466c-a658-eef59002e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:32.436455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203fa77-868d-466c-a658-eef59002e56a admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.436898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203fa77-868d-466c-a658-eef59002e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.437328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203fa77-868d-466c-a658-eef59002e56a admin admin] PATH_INFO: `/v3/projects/3e6463074f1d47738a1aed866d960819/users/a34c0823c36d43fdbe929f7b3d59c74f/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.439789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203fa77-868d-466c-a658-eef59002e56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6463074f1d47738a1aed866d960819, user_id=a34c0823c36d43fdbe929f7b3d59c74f, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:32.442111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 789/1604] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:32.443438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203fa77-868d-466c-a658-eef59002e56a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:32.452402 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433ba08-adbc-42cc-b018-57028938b31d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.452921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433ba08-adbc-42cc-b018-57028938b31d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.453247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433ba08-adbc-42cc-b018-57028938b31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.459144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 816/1605] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:32 2022] PUT /identity/v3/projects/3e6463074f1d47738a1aed866d960819/users/a34c0823c36d43fdbe929f7b3d59c74f/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:32.470483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a6c5-19a5-46bd-b138-398795fa9945 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.471031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a6c5-19a5-46bd-b138-398795fa9945 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.471144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a6c5-19a5-46bd-b138-398795fa9945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.491182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2433ba08-adbc-42cc-b018-57028938b31d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:32.492522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2433ba08-adbc-42cc-b018-57028938b31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:32.506769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9946a6c5-19a5-46bd-b138-398795fa9945 None None] MFA Rules not processed for user `a34c0823c36d43fdbe929f7b3d59c74f`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:32.506769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9946a6c5-19a5-46bd-b138-398795fa9945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:32.583521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:32.626065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 790/1606] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:32.627426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433ba08-adbc-42cc-b018-57028938b31d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:32.640583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 817/1607] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:32.654016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433ba08-adbc-42cc-b018-57028938b31d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:32.663541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114286c-4c88-42c4-96af-c489035f3ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:32.664771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114286c-4c88-42c4-96af-c489035f3ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.665302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114286c-4c88-42c4-96af-c489035f3ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.665431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946a6c5-19a5-46bd-b138-398795fa9945 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:32.666019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114286c-4c88-42c4-96af-c489035f3ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.666923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114286c-4c88-42c4-96af-c489035f3ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:32.667259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9946a6c5-19a5-46bd-b138-398795fa9945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:32.668903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114286c-4c88-42c4-96af-c489035f3ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:32.672561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114286c-4c88-42c4-96af-c489035f3ab1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:32.702449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 791/1608] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:32.731350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114286c-4c88-42c4-96af-c489035f3ab1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:32.765576 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114286c-4c88-42c4-96af-c489035f3ab1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:32.774212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946a6c5-19a5-46bd-b138-398795fa9945 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:32.782296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb919a-aa3c-4b7c-ab93-ab05cbccf772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:32.782296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb919a-aa3c-4b7c-ab93-ab05cbccf772 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.782296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb919a-aa3c-4b7c-ab93-ab05cbccf772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.782296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb919a-aa3c-4b7c-ab93-ab05cbccf772 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.782972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb919a-aa3c-4b7c-ab93-ab05cbccf772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:32.786311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb919a-aa3c-4b7c-ab93-ab05cbccf772 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:32.791057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91540671-2e34-48fe-ae0f-e6bd0d3f9008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:32.792098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91540671-2e34-48fe-ae0f-e6bd0d3f9008 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:32.792711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91540671-2e34-48fe-ae0f-e6bd0d3f9008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:32.793096 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91540671-2e34-48fe-ae0f-e6bd0d3f9008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:32.819654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91540671-2e34-48fe-ae0f-e6bd0d3f9008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:32.832209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91540671-2e34-48fe-ae0f-e6bd0d3f9008 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:32.853348 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:32.866687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 818/1609] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:32.868889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91540671-2e34-48fe-ae0f-e6bd0d3f9008 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:32.871243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-91540671-2e34-48fe-ae0f-e6bd0d3f9008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:32.912353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91540671-2e34-48fe-ae0f-e6bd0d3f9008 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:32.915149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 792/1610] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:32 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:32.917426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb919a-aa3c-4b7c-ab93-ab05cbccf772 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:33.037684 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:33.041384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb919a-aa3c-4b7c-ab93-ab05cbccf772 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:33.042209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.043259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.044318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] PATH_INFO: `/v3/users/f10cac91906047b4a478dad895f8cdb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.048172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10cac91906047b4a478dad895f8cdb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:33.048298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e98a1-e90a-4bbf-96f6-6f3eeb651f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:33.049142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e98a1-e90a-4bbf-96f6-6f3eeb651f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.049429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e98a1-e90a-4bbf-96f6-6f3eeb651f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.049919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e98a1-e90a-4bbf-96f6-6f3eeb651f8b admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.050646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e98a1-e90a-4bbf-96f6-6f3eeb651f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:33.053553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e98a1-e90a-4bbf-96f6-6f3eeb651f8b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:33.055344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:33.096965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 793/1611] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:32 2022] POST /identity/v3/users => generated 282 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:33.098656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e98a1-e90a-4bbf-96f6-6f3eeb651f8b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:33.138942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10cac91906047b4a478dad895f8cdb6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:33.156552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10cac91906047b4a478dad895f8cdb6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:33.168387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10cac91906047b4a478dad895f8cdb6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:33.170537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10cac91906047b4a478dad895f8cdb6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:33.187314 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10cac91906047b4a478dad895f8cdb6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:33.202203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 819/1612] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:32 2022] DELETE /identity/v3/users/f10cac91906047b4a478dad895f8cdb6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:33.203541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:33.205178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:33.224363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e98a1-e90a-4bbf-96f6-6f3eeb651f8b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:33.311194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:33.311833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.312116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.312390 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.314446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:33.330854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:33.331036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74e242-ae77-48b3-9223-48f26dedf86b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:33.332271 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4238839-7201-49a5-81ae-c748194d009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:33.332968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238839-7201-49a5-81ae-c748194d009a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.333314 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238839-7201-49a5-81ae-c748194d009a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.333663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238839-7201-49a5-81ae-c748194d009a admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.334398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4238839-7201-49a5-81ae-c748194d009a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:33.337835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4238839-7201-49a5-81ae-c748194d009a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:33.356218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 820/1613] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:33.357804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea83697-26c5-42f8-ad82-1dffa79384d5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.358088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea83697-26c5-42f8-ad82-1dffa79384d5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.358357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea83697-26c5-42f8-ad82-1dffa79384d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.378210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2ea83697-26c5-42f8-ad82-1dffa79384d5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:33.379610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2ea83697-26c5-42f8-ad82-1dffa79384d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:33.388413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 821/1614] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:33.389159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea83697-26c5-42f8-ad82-1dffa79384d5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:33.394358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:33.396551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:33.400023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea83697-26c5-42f8-ad82-1dffa79384d5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:33.404860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9fe04-7f31-44f1-93dc-3042d729aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:33.405479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9fe04-7f31-44f1-93dc-3042d729aeeb admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.405811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9fe04-7f31-44f1-93dc-3042d729aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.406098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9fe04-7f31-44f1-93dc-3042d729aeeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.406964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9fe04-7f31-44f1-93dc-3042d729aeeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:33.409004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9fe04-7f31-44f1-93dc-3042d729aeeb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:33.409724 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 794/1615] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:33.410492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:33.412123 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:33.416648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:33.436432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 822/1616] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:33.437816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9fe04-7f31-44f1-93dc-3042d729aeeb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:33.468313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9fe04-7f31-44f1-93dc-3042d729aeeb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:33.475611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b78958-1e03-444c-8f2c-5b6b73dac2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:33.476366 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78958-1e03-444c-8f2c-5b6b73dac2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.476711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78958-1e03-444c-8f2c-5b6b73dac2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.477052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78958-1e03-444c-8f2c-5b6b73dac2ec admin admin] PATH_INFO: `/v3/projects/c4cbf63c6ed74c1db8299b2cbacc7e2a/users/5f7234d1597b493ea9ec9a261bd6fdd5/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.497072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bcf9b-120d-4fe0-b817-9c52641b9d75 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:33.498238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b78958-1e03-444c-8f2c-5b6b73dac2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4cbf63c6ed74c1db8299b2cbacc7e2a, user_id=5f7234d1597b493ea9ec9a261bd6fdd5, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:33.503130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b78958-1e03-444c-8f2c-5b6b73dac2ec admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:33.503298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf79a-f5bb-44c4-acb5-76a4518e9ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:33.503910 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf79a-f5bb-44c4-acb5-76a4518e9ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.504271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf79a-f5bb-44c4-acb5-76a4518e9ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.504657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf79a-f5bb-44c4-acb5-76a4518e9ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.519826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf79a-f5bb-44c4-acb5-76a4518e9ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:33.522248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf79a-f5bb-44c4-acb5-76a4518e9ad4 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:33.525858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 823/1617] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:33 2022] PUT /identity/v3/projects/c4cbf63c6ed74c1db8299b2cbacc7e2a/users/5f7234d1597b493ea9ec9a261bd6fdd5/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:33.533315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 795/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:33.537418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42b31-3190-4964-9963-625bec83771a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.537709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42b31-3190-4964-9963-625bec83771a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.537981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42b31-3190-4964-9963-625bec83771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.568892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-97f42b31-3190-4964-9963-625bec83771a None None] MFA Rules not processed for user `5f7234d1597b493ea9ec9a261bd6fdd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:33.570257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-97f42b31-3190-4964-9963-625bec83771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:33.648065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 824/1619] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:33.659908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf79a-f5bb-44c4-acb5-76a4518e9ad4 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:33.661400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5decf79a-f5bb-44c4-acb5-76a4518e9ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:33.673424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf79a-f5bb-44c4-acb5-76a4518e9ad4 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:33.728874 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a3dc5-355c-4e37-9929-24a553924795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:33.729490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a3dc5-355c-4e37-9929-24a553924795 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.729769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a3dc5-355c-4e37-9929-24a553924795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.730039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a3dc5-355c-4e37-9929-24a553924795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.738688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a3dc5-355c-4e37-9929-24a553924795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:33.740080 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a3dc5-355c-4e37-9929-24a553924795 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:33.749840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 796/1620] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:33.832100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42b31-3190-4964-9963-625bec83771a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:33.833617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-97f42b31-3190-4964-9963-625bec83771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:33.935257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42b31-3190-4964-9963-625bec83771a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:33.943657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:33.944587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:33.944955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:33.945281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] PATH_INFO: `/v3/projects/686de9ffff0a4810b2beeb2332996b35` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:33.946856 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686de9ffff0a4810b2beeb2332996b35)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:33.949951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:34.047085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686de9ffff0a4810b2beeb2332996b35', 'request_id': 'req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.053800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686de9ffff0a4810b2beeb2332996b35', 'request_id': 'req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.063808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686de9ffff0a4810b2beeb2332996b35', 'request_id': 'req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.068758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:34.091512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] The token cache is being invalidate because project 686de9ffff0a4810b2beeb2332996b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:34.092023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.093171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.095354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 825/1621] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:33 2022] DELETE /identity/v3/projects/686de9ffff0a4810b2beeb2332996b35 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:34.101594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a3dc5-355c-4e37-9929-24a553924795 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:34.124471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a3dc5-355c-4e37-9929-24a553924795 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:34.204129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:34.205280 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:34.208884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:34.213696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:34.214830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:34.215259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:34.215760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] PATH_INFO: `/v3/users/63a5ba591cc84ffea5d31f363ac11cda` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:34.217211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a5ba591cc84ffea5d31f363ac11cda)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:34.220639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:34.224261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ae59-7188-4e6d-be1e-693d959c0ac0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:34.230307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:34.231255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:34.231540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:34.231815 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] PATH_INFO: `/v3/users/fb3a8f7737e749dfa91513f811842953` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:34.233406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3a8f7737e749dfa91513f811842953)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:34.235891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:34.284291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a5ba591cc84ffea5d31f363ac11cda'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.292080 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a5ba591cc84ffea5d31f363ac11cda'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.299003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3a8f7737e749dfa91513f811842953'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.307616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a5ba591cc84ffea5d31f363ac11cda'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.315633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3a8f7737e749dfa91513f811842953'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.315785 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a5ba591cc84ffea5d31f363ac11cda'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.316740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d9dc60a0-9431-4624-82e0-6c91e7456225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a5ba591cc84ffea5d31f363ac11cda'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.324013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3a8f7737e749dfa91513f811842953'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.324747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 797/1622] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:34 2022] DELETE /identity/v3/users/63a5ba591cc84ffea5d31f363ac11cda => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:34.324857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3a8f7737e749dfa91513f811842953'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.341468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3a8f7737e749dfa91513f811842953'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.348582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 826/1623] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:34 2022] DELETE /identity/v3/users/fb3a8f7737e749dfa91513f811842953 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:34.352967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb15dc2-052c-40e2-b6c4-2122c32029c6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:34.353247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb15dc2-052c-40e2-b6c4-2122c32029c6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:34.353573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb15dc2-052c-40e2-b6c4-2122c32029c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:34.380842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-aeb15dc2-052c-40e2-b6c4-2122c32029c6 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:34.382401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aeb15dc2-052c-40e2-b6c4-2122c32029c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:34.497802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 798/1624] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:34.515462 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:34.516953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:34.592172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3c295-8121-4543-b5de-4e099c821e2d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:34.601116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12bc72-6b16-4797-80c9-7565288d6cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:34.601806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12bc72-6b16-4797-80c9-7565288d6cdf service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:34.602069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12bc72-6b16-4797-80c9-7565288d6cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:34.602358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12bc72-6b16-4797-80c9-7565288d6cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:34.612859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12bc72-6b16-4797-80c9-7565288d6cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:34.616203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12bc72-6b16-4797-80c9-7565288d6cdf service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:34.637337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 827/1625] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:34.840753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb15dc2-052c-40e2-b6c4-2122c32029c6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:34.842424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aeb15dc2-052c-40e2-b6c4-2122c32029c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:34.860017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb15dc2-052c-40e2-b6c4-2122c32029c6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:34.866975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:34.868199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:34.869394 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:34.870010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] PATH_INFO: `/v3/projects/e828a97582d348dfaea0aab319c764fc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:34.871701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e828a97582d348dfaea0aab319c764fc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:34.876341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:34.942571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e828a97582d348dfaea0aab319c764fc', 'request_id': 'req-681eb898-6b2c-406b-a0e3-c249d6e9a54d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.959547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e828a97582d348dfaea0aab319c764fc', 'request_id': 'req-681eb898-6b2c-406b-a0e3-c249d6e9a54d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.970461 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e828a97582d348dfaea0aab319c764fc', 'request_id': 'req-681eb898-6b2c-406b-a0e3-c249d6e9a54d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.980737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:34.987191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] The token cache is being invalidate because project e828a97582d348dfaea0aab319c764fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:34.987931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.989040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:34.995096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 799/1626] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:34 2022] DELETE /identity/v3/projects/e828a97582d348dfaea0aab319c764fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:34.996274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12bc72-6b16-4797-80c9-7565288d6cdf service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:35.011764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12bc72-6b16-4797-80c9-7565288d6cdf service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:35.147426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:35.149135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:35.149794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:35.149794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] PATH_INFO: `/v3/users/d892c80fd07b41afa6c6a54502e90407` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:35.151917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d892c80fd07b41afa6c6a54502e90407)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:35.157925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:35.176079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:35.203834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:35.207201 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:35.229554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb898-6b2c-406b-a0e3-c249d6e9a54d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:35.239018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:35.239677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:35.239958 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:35.240231 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] PATH_INFO: `/v3/projects/999e56a51231411e8e03e1b6de9267bc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:35.241701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=999e56a51231411e8e03e1b6de9267bc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:35.243685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:35.275570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd892c80fd07b41afa6c6a54502e90407'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.290664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd892c80fd07b41afa6c6a54502e90407'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.301986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd892c80fd07b41afa6c6a54502e90407'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.303021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd892c80fd07b41afa6c6a54502e90407'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.323054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd892c80fd07b41afa6c6a54502e90407'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.331244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 828/1627] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:34 2022] DELETE /identity/v3/users/d892c80fd07b41afa6c6a54502e90407 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:35.362057 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999e56a51231411e8e03e1b6de9267bc', 'request_id': 'req-ca16c73d-392c-4390-b03c-08cb7833bb0d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.374694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999e56a51231411e8e03e1b6de9267bc', 'request_id': 'req-ca16c73d-392c-4390-b03c-08cb7833bb0d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.386815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999e56a51231411e8e03e1b6de9267bc', 'request_id': 'req-ca16c73d-392c-4390-b03c-08cb7833bb0d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.406263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] The token cache is being invalidate because project 999e56a51231411e8e03e1b6de9267bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:35.407119 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.407975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.412342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 800/1628] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:35 2022] DELETE /identity/v3/projects/999e56a51231411e8e03e1b6de9267bc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:35.416501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:35.418557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:35.579994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb26ce-4278-4553-9ff6-acde49932da5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:35.588423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:35.588907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:35.589245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:35.589531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] PATH_INFO: `/v3/users/33bf4a6d7889443b9ed79d2f39c61428` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:35.590740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bf4a6d7889443b9ed79d2f39c61428)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:35.592685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:35.701745 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bf4a6d7889443b9ed79d2f39c61428'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.720596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bf4a6d7889443b9ed79d2f39c61428'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.730863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bf4a6d7889443b9ed79d2f39c61428'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.731657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bf4a6d7889443b9ed79d2f39c61428'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.758472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8cb76516-3eed-4579-958b-d81096bf4eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bf4a6d7889443b9ed79d2f39c61428'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:35.774892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 829/1629] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:35 2022] DELETE /identity/v3/users/33bf4a6d7889443b9ed79d2f39c61428 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:35.905870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:35.907681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:36.078893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c73d-392c-4390-b03c-08cb7833bb0d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:36.213544 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:36.214536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.214966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.215370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] PATH_INFO: `/v3/projects/f52911dea53b4acbbd8cc9b58c359016` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.216818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52911dea53b4acbbd8cc9b58c359016)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:36.220234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:36.280531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:36.305224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52911dea53b4acbbd8cc9b58c359016', 'request_id': 'req-7ab8aca3-0536-472f-9625-92e0535c1fcc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.351911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52911dea53b4acbbd8cc9b58c359016', 'request_id': 'req-7ab8aca3-0536-472f-9625-92e0535c1fcc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.361466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52911dea53b4acbbd8cc9b58c359016', 'request_id': 'req-7ab8aca3-0536-472f-9625-92e0535c1fcc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.379358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] The token cache is being invalidate because project f52911dea53b4acbbd8cc9b58c359016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:36.379866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.380536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7ab8aca3-0536-472f-9625-92e0535c1fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.390119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f755092-c598-4848-9fe8-d0068480a8ce None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.390598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 801/1630] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:35 2022] DELETE /identity/v3/projects/f52911dea53b4acbbd8cc9b58c359016 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:36.390700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f755092-c598-4848-9fe8-d0068480a8ce None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.390700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f755092-c598-4848-9fe8-d0068480a8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.416671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:36.423912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3f755092-c598-4848-9fe8-d0068480a8ce None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:36.427574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3f755092-c598-4848-9fe8-d0068480a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:36.503519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 830/1631] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:36.517886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bd843-c6ae-47dd-a0b9-eea81926cb53 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.518460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bd843-c6ae-47dd-a0b9-eea81926cb53 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.518764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bd843-c6ae-47dd-a0b9-eea81926cb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.536538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f755092-c598-4848-9fe8-d0068480a8ce None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:36.538676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3f755092-c598-4848-9fe8-d0068480a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:36.560307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f96bd843-c6ae-47dd-a0b9-eea81926cb53 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:36.561653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f96bd843-c6ae-47dd-a0b9-eea81926cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:36.565768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f755092-c598-4848-9fe8-d0068480a8ce None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:36.572489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 802/1632] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:36.577130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bd843-c6ae-47dd-a0b9-eea81926cb53 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:36.579953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:36.580623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.580908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.581164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] PATH_INFO: `/v3/projects/b73956f488a241b996705fdf923f4e1d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.582319 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b73956f488a241b996705fdf923f4e1d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:36.584268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:36.595103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bd843-c6ae-47dd-a0b9-eea81926cb53 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:36.601585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e58fab-5cdc-4075-a864-967eb9565080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:36.602209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58fab-5cdc-4075-a864-967eb9565080 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.602799 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58fab-5cdc-4075-a864-967eb9565080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.602799 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58fab-5cdc-4075-a864-967eb9565080 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.603552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e58fab-5cdc-4075-a864-967eb9565080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:36.603854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e58fab-5cdc-4075-a864-967eb9565080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:36.605602 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e58fab-5cdc-4075-a864-967eb9565080 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:36.624775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 803/1633] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:36.629538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e58fab-5cdc-4075-a864-967eb9565080 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:36.640308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e58fab-5cdc-4075-a864-967eb9565080 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:36.657633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b73956f488a241b996705fdf923f4e1d', 'request_id': 'req-406e9966-1547-4a25-bcf2-42a3744c009f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.667284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b73956f488a241b996705fdf923f4e1d', 'request_id': 'req-406e9966-1547-4a25-bcf2-42a3744c009f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.676640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b73956f488a241b996705fdf923f4e1d', 'request_id': 'req-406e9966-1547-4a25-bcf2-42a3744c009f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.697781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] The token cache is being invalidate because project b73956f488a241b996705fdf923f4e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:36.698083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.698837 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-406e9966-1547-4a25-bcf2-42a3744c009f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:36.702283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 831/1634] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:36 2022] DELETE /identity/v3/projects/b73956f488a241b996705fdf923f4e1d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:36.708274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eab98-d9d6-4c90-9115-b7a39124e4c4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.708748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eab98-d9d6-4c90-9115-b7a39124e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.709147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eab98-d9d6-4c90-9115-b7a39124e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.733987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05187794-bb51-4eb6-9e38-b3b0095f8094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:36.734565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187794-bb51-4eb6-9e38-b3b0095f8094 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.734687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-760eab98-d9d6-4c90-9115-b7a39124e4c4 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:36.734914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187794-bb51-4eb6-9e38-b3b0095f8094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.735200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187794-bb51-4eb6-9e38-b3b0095f8094 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.735847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05187794-bb51-4eb6-9e38-b3b0095f8094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:36.736406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-760eab98-d9d6-4c90-9115-b7a39124e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:36.737868 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05187794-bb51-4eb6-9e38-b3b0095f8094 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:36.747881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 832/1635] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:36.762887 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564c067-1116-4e2d-a84b-d73d07e239da None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.762887 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564c067-1116-4e2d-a84b-d73d07e239da None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.762887 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564c067-1116-4e2d-a84b-d73d07e239da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.777045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 804/1636] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:36 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:36.778617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d564c067-1116-4e2d-a84b-d73d07e239da None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:36.780085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d564c067-1116-4e2d-a84b-d73d07e239da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:36.786656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05187794-bb51-4eb6-9e38-b3b0095f8094 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:36.789811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-05187794-bb51-4eb6-9e38-b3b0095f8094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:36.870442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05187794-bb51-4eb6-9e38-b3b0095f8094 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:36.876420 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621649-fe33-4ea1-ba2c-b64f632b3958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:36.877033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621649-fe33-4ea1-ba2c-b64f632b3958 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.877315 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621649-fe33-4ea1-ba2c-b64f632b3958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.877629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621649-fe33-4ea1-ba2c-b64f632b3958 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.878274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a621649-fe33-4ea1-ba2c-b64f632b3958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:36.880232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a621649-fe33-4ea1-ba2c-b64f632b3958 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:36.886899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 833/1637] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:36.891059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564c067-1116-4e2d-a84b-d73d07e239da None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:36.905010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564c067-1116-4e2d-a84b-d73d07e239da None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:36.912771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 805/1638] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:36 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:36.914665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621649-fe33-4ea1-ba2c-b64f632b3958 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:36.919335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508024ab-07f7-49a7-b52e-20c2f6a261b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:36.920212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508024ab-07f7-49a7-b52e-20c2f6a261b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.920831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508024ab-07f7-49a7-b52e-20c2f6a261b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.921238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508024ab-07f7-49a7-b52e-20c2f6a261b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.922315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508024ab-07f7-49a7-b52e-20c2f6a261b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:36.922828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508024ab-07f7-49a7-b52e-20c2f6a261b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:36.924610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508024ab-07f7-49a7-b52e-20c2f6a261b8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:36.937260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621649-fe33-4ea1-ba2c-b64f632b3958 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:36.940678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 834/1639] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:24:36.944558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508024ab-07f7-49a7-b52e-20c2f6a261b8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:36.948650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b771ff3-9416-4972-8be2-16f327183125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:36.952500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b771ff3-9416-4972-8be2-16f327183125 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.952810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b771ff3-9416-4972-8be2-16f327183125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.954249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b771ff3-9416-4972-8be2-16f327183125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.956446 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508024ab-07f7-49a7-b52e-20c2f6a261b8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:36.957015 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b771ff3-9416-4972-8be2-16f327183125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:36.961658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b771ff3-9416-4972-8be2-16f327183125 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:36.962656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2838a-288a-4534-94dc-93b2f4812f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:36.963616 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2838a-288a-4534-94dc-93b2f4812f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:36.964054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2838a-288a-4534-94dc-93b2f4812f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:36.964510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2838a-288a-4534-94dc-93b2f4812f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:36.966492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2838a-288a-4534-94dc-93b2f4812f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:36.970131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2838a-288a-4534-94dc-93b2f4812f3a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:36.986224 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:37.015926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 835/1640] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:36 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:37.016952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 806/1641] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:37.018659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2838a-288a-4534-94dc-93b2f4812f3a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.020327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b771ff3-9416-4972-8be2-16f327183125 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.033630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:37.046239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b771ff3-9416-4972-8be2-16f327183125 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:37.110367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2838a-288a-4534-94dc-93b2f4812f3a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:37.115395 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e1ec-9a88-435d-bf78-5a70078aaab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:37.116142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e1ec-9a88-435d-bf78-5a70078aaab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.116515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e1ec-9a88-435d-bf78-5a70078aaab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.116880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e1ec-9a88-435d-bf78-5a70078aaab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.117642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84e1ec-9a88-435d-bf78-5a70078aaab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:37.119471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84e1ec-9a88-435d-bf78-5a70078aaab5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:37.131611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 836/1642] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:37.135707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e1ec-9a88-435d-bf78-5a70078aaab5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.147120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e1ec-9a88-435d-bf78-5a70078aaab5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:37.157106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965278f5-e290-4bbc-b28a-490968bab8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:37.158463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965278f5-e290-4bbc-b28a-490968bab8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.158974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965278f5-e290-4bbc-b28a-490968bab8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.159350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965278f5-e290-4bbc-b28a-490968bab8ad admin admin] PATH_INFO: `/v3/projects/151e7f1b0c11466da5ba0617107c6a6f/users/b3f4232e1bc44bc59bca9104eedbe92c/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.169480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0caf4-c02b-4fb9-ab15-4548bf13728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:37.170129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0caf4-c02b-4fb9-ab15-4548bf13728f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.170411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0caf4-c02b-4fb9-ab15-4548bf13728f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.170698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0caf4-c02b-4fb9-ab15-4548bf13728f admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.171378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0caf4-c02b-4fb9-ab15-4548bf13728f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:37.177589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0caf4-c02b-4fb9-ab15-4548bf13728f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:37.186550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965278f5-e290-4bbc-b28a-490968bab8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=151e7f1b0c11466da5ba0617107c6a6f, user_id=b3f4232e1bc44bc59bca9104eedbe92c, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:37.189474 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965278f5-e290-4bbc-b28a-490968bab8ad admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:37.230743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 837/1643] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:37 2022] PUT /identity/v3/projects/151e7f1b0c11466da5ba0617107c6a6f/users/b3f4232e1bc44bc59bca9104eedbe92c/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:37.231432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 807/1644] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:37 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:37.237370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e748ad-7df5-4195-b689-67a4c8349ef5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.237370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e748ad-7df5-4195-b689-67a4c8349ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.237370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e748ad-7df5-4195-b689-67a4c8349ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.239908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0caf4-c02b-4fb9-ab15-4548bf13728f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.282744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0caf4-c02b-4fb9-ab15-4548bf13728f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:37.311383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-76e748ad-7df5-4195-b689-67a4c8349ef5 None None] MFA Rules not processed for user `b3f4232e1bc44bc59bca9104eedbe92c`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:37.328394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-76e748ad-7df5-4195-b689-67a4c8349ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:37.420150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e1acb-e303-4707-8f37-ad99aa543b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:37.422018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e1acb-e303-4707-8f37-ad99aa543b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.422505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e1acb-e303-4707-8f37-ad99aa543b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.423017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e1acb-e303-4707-8f37-ad99aa543b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.424013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e1acb-e303-4707-8f37-ad99aa543b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:37.429089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e1acb-e303-4707-8f37-ad99aa543b00 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:37.452473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 808/1645] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:37.459001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e1acb-e303-4707-8f37-ad99aa543b00 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.482182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e1acb-e303-4707-8f37-ad99aa543b00 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:37.494503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 838/1646] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:37.499269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e748ad-7df5-4195-b689-67a4c8349ef5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.500738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3cc0-78f6-41b0-aa9c-e4bf4a8ca0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:37.501406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3cc0-78f6-41b0-aa9c-e4bf4a8ca0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.501666 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3cc0-78f6-41b0-aa9c-e4bf4a8ca0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.501946 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3cc0-78f6-41b0-aa9c-e4bf4a8ca0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.502610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a3cc0-78f6-41b0-aa9c-e4bf4a8ca0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:37.507581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a3cc0-78f6-41b0-aa9c-e4bf4a8ca0b8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:37.532608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e748ad-7df5-4195-b689-67a4c8349ef5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:37.538067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 809/1647] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:37.542081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3cc0-78f6-41b0-aa9c-e4bf4a8ca0b8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.548667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a85e33-5a86-4ad1-8f1b-56da39ee86e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:37.549036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a85e33-5a86-4ad1-8f1b-56da39ee86e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.549324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a85e33-5a86-4ad1-8f1b-56da39ee86e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.549598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a85e33-5a86-4ad1-8f1b-56da39ee86e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.550249 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a85e33-5a86-4ad1-8f1b-56da39ee86e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:37.552189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a85e33-5a86-4ad1-8f1b-56da39ee86e6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:37.562427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3cc0-78f6-41b0-aa9c-e4bf4a8ca0b8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:37.574342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7d48d-5cad-46ff-808a-0f9912a9825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:37.577124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7d48d-5cad-46ff-808a-0f9912a9825e admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.577525 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7d48d-5cad-46ff-808a-0f9912a9825e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.578117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7d48d-5cad-46ff-808a-0f9912a9825e admin admin] PATH_INFO: `/v3/projects/c2e2fa8c4cec4e82b974ef9a04927334/users/e1b7029fc33b42e489b2f8d64a51225f/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.617508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7d48d-5cad-46ff-808a-0f9912a9825e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e2fa8c4cec4e82b974ef9a04927334, user_id=e1b7029fc33b42e489b2f8d64a51225f, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:37.620364 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7d48d-5cad-46ff-808a-0f9912a9825e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:37.633428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 839/1648] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:37 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:37.634337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a85e33-5a86-4ad1-8f1b-56da39ee86e6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.637781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 810/1649] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:37 2022] PUT /identity/v3/projects/c2e2fa8c4cec4e82b974ef9a04927334/users/e1b7029fc33b42e489b2f8d64a51225f/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:37.648490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99145a0-d60f-449f-84f7-1fd5ff9f8d48 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.648779 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99145a0-d60f-449f-84f7-1fd5ff9f8d48 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.649584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99145a0-d60f-449f-84f7-1fd5ff9f8d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.683127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a99145a0-d60f-449f-84f7-1fd5ff9f8d48 None None] MFA Rules not processed for user `e1b7029fc33b42e489b2f8d64a51225f`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:37.684795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a99145a0-d60f-449f-84f7-1fd5ff9f8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:37.688676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:37.738259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:37.746960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a85e33-5a86-4ad1-8f1b-56da39ee86e6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:37.770842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 811/1650] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:37.774049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99145a0-d60f-449f-84f7-1fd5ff9f8d48 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.843019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ed742-f373-437c-9ad2-936bd7bd0ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:37.844145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ed742-f373-437c-9ad2-936bd7bd0ade admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.847046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ed742-f373-437c-9ad2-936bd7bd0ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.847643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ed742-f373-437c-9ad2-936bd7bd0ade admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.849461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ed742-f373-437c-9ad2-936bd7bd0ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:37.854143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ed742-f373-437c-9ad2-936bd7bd0ade admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:37.865040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99145a0-d60f-449f-84f7-1fd5ff9f8d48 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:37.869795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0f2e8-cdb9-422f-99ab-8fb0dc8cfb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:37.871327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0f2e8-cdb9-422f-99ab-8fb0dc8cfb20 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:37.871327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0f2e8-cdb9-422f-99ab-8fb0dc8cfb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:37.871327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0f2e8-cdb9-422f-99ab-8fb0dc8cfb20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:37.871788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0f2e8-cdb9-422f-99ab-8fb0dc8cfb20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:37.874071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0f2e8-cdb9-422f-99ab-8fb0dc8cfb20 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:37.900935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 840/1651] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:37 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:37.905549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ed742-f373-437c-9ad2-936bd7bd0ade admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.919306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 812/1652] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:37 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:37.923874 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0f2e8-cdb9-422f-99ab-8fb0dc8cfb20 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:37.930681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ed742-f373-437c-9ad2-936bd7bd0ade admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.033470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05166b-189a-4594-8522-f32149af5488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.034280 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05166b-189a-4594-8522-f32149af5488 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.034659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05166b-189a-4594-8522-f32149af5488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.035100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05166b-189a-4594-8522-f32149af5488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.035960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05166b-189a-4594-8522-f32149af5488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.038602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05166b-189a-4594-8522-f32149af5488 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.050867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 841/1653] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:38.052621 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0f2e8-cdb9-422f-99ab-8fb0dc8cfb20 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.054862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05166b-189a-4594-8522-f32149af5488 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.058595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782da99-8404-4b62-9031-225e558b130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.059327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782da99-8404-4b62-9031-225e558b130a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.059600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782da99-8404-4b62-9031-225e558b130a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.059866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782da99-8404-4b62-9031-225e558b130a admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.060607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782da99-8404-4b62-9031-225e558b130a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.062690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782da99-8404-4b62-9031-225e558b130a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.065971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05166b-189a-4594-8522-f32149af5488 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.071590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ae23f-9b18-43e8-93ad-7bc3783a84c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.072585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ae23f-9b18-43e8-93ad-7bc3783a84c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.072926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ae23f-9b18-43e8-93ad-7bc3783a84c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.073371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ae23f-9b18-43e8-93ad-7bc3783a84c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.074111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ae23f-9b18-43e8-93ad-7bc3783a84c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.076516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ae23f-9b18-43e8-93ad-7bc3783a84c4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.094505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 842/1654] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:38.094505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ae23f-9b18-43e8-93ad-7bc3783a84c4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.095359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 813/1655] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:37 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:38.096586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782da99-8404-4b62-9031-225e558b130a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.106105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ae23f-9b18-43e8-93ad-7bc3783a84c4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.109803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782da99-8404-4b62-9031-225e558b130a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.111771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5758-1a0d-4956-9492-cec51d30efce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.112472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5758-1a0d-4956-9492-cec51d30efce admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.113451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5758-1a0d-4956-9492-cec51d30efce admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.113809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5758-1a0d-4956-9492-cec51d30efce admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.114559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b5758-1a0d-4956-9492-cec51d30efce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.115863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cc839-29c2-4812-b3c9-9f41fdde3452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.116449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b5758-1a0d-4956-9492-cec51d30efce admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.117150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc839-29c2-4812-b3c9-9f41fdde3452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.117611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc839-29c2-4812-b3c9-9f41fdde3452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.118591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc839-29c2-4812-b3c9-9f41fdde3452 admin admin] PATH_INFO: `/v3/projects/040f1e22f7e94a00b046bcee3d9077cc/users/0dcd06e3c7334a71be05d7b82f8ec6ab/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.130761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 843/1656] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:38.134901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5758-1a0d-4956-9492-cec51d30efce admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.140543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cc839-29c2-4812-b3c9-9f41fdde3452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040f1e22f7e94a00b046bcee3d9077cc, user_id=0dcd06e3c7334a71be05d7b82f8ec6ab, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.144207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cc839-29c2-4812-b3c9-9f41fdde3452 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.147639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5758-1a0d-4956-9492-cec51d30efce admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.155359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618a84b-55f2-45e2-8d05-993047695884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.157266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618a84b-55f2-45e2-8d05-993047695884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.157777 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618a84b-55f2-45e2-8d05-993047695884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.158210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618a84b-55f2-45e2-8d05-993047695884 admin admin] PATH_INFO: `/v3/projects/9b86992ea63543d8abe87bde0067ea31/users/629e31fe299c4ab98f645364a92731b9/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.181490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 814/1657] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:38 2022] PUT /identity/v3/projects/040f1e22f7e94a00b046bcee3d9077cc/users/0dcd06e3c7334a71be05d7b82f8ec6ab/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:38.192678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06450e18-f3a3-4b02-a1bc-89fea1b469fc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.193528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06450e18-f3a3-4b02-a1bc-89fea1b469fc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.193984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06450e18-f3a3-4b02-a1bc-89fea1b469fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.195436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618a84b-55f2-45e2-8d05-993047695884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b86992ea63543d8abe87bde0067ea31, user_id=629e31fe299c4ab98f645364a92731b9, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.198211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618a84b-55f2-45e2-8d05-993047695884 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.214977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 844/1658] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:38 2022] PUT /identity/v3/projects/9b86992ea63543d8abe87bde0067ea31/users/629e31fe299c4ab98f645364a92731b9/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:38.218659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618a84b-55f2-45e2-8d05-993047695884 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.230531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-06450e18-f3a3-4b02-a1bc-89fea1b469fc None None] MFA Rules not processed for user `0dcd06e3c7334a71be05d7b82f8ec6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:38.232173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-06450e18-f3a3-4b02-a1bc-89fea1b469fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:38.240280 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:38.257888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:38.292649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618a84b-55f2-45e2-8d05-993047695884 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.298361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e4a0e-6e17-4282-b1b0-cc0b4c47518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.299046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4a0e-6e17-4282-b1b0-cc0b4c47518c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.299329 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4a0e-6e17-4282-b1b0-cc0b4c47518c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.299628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4a0e-6e17-4282-b1b0-cc0b4c47518c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.300340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e4a0e-6e17-4282-b1b0-cc0b4c47518c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.301870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e4a0e-6e17-4282-b1b0-cc0b4c47518c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.315878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 845/1659] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:38.316668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e4a0e-6e17-4282-b1b0-cc0b4c47518c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.317628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 815/1660] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:38.321800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06450e18-f3a3-4b02-a1bc-89fea1b469fc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.326839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e4a0e-6e17-4282-b1b0-cc0b4c47518c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.331805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97d305-854b-4430-a828-07d36869d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.332592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97d305-854b-4430-a828-07d36869d936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.332900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97d305-854b-4430-a828-07d36869d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.333177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97d305-854b-4430-a828-07d36869d936 admin admin] PATH_INFO: `/v3/projects/9b86992ea63543d8abe87bde0067ea31/users/629e31fe299c4ab98f645364a92731b9/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.333281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06450e18-f3a3-4b02-a1bc-89fea1b469fc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.335157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97d305-854b-4430-a828-07d36869d936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b86992ea63543d8abe87bde0067ea31, user_id=629e31fe299c4ab98f645364a92731b9, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.337831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97d305-854b-4430-a828-07d36869d936 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.338233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd9a4-5a7d-4409-8f3d-a192bcd87bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.339043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd9a4-5a7d-4409-8f3d-a192bcd87bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.339322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd9a4-5a7d-4409-8f3d-a192bcd87bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.339593 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd9a4-5a7d-4409-8f3d-a192bcd87bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.340230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dd9a4-5a7d-4409-8f3d-a192bcd87bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.342171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dd9a4-5a7d-4409-8f3d-a192bcd87bb0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.358702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 846/1661] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:38 2022] PUT /identity/v3/projects/9b86992ea63543d8abe87bde0067ea31/users/629e31fe299c4ab98f645364a92731b9/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:38.370061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2516b-4794-4e74-af82-9a220d4720bb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.370350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2516b-4794-4e74-af82-9a220d4720bb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.370625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2516b-4794-4e74-af82-9a220d4720bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.388286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 816/1662] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:38 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:38.389138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd9a4-5a7d-4409-8f3d-a192bcd87bb0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.400787 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1fc2516b-4794-4e74-af82-9a220d4720bb None None] MFA Rules not processed for user `629e31fe299c4ab98f645364a92731b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:38.402252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1fc2516b-4794-4e74-af82-9a220d4720bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:38.460394 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd9a4-5a7d-4409-8f3d-a192bcd87bb0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.465535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef073e-c611-46a8-964b-c35de66fcbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.466151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef073e-c611-46a8-964b-c35de66fcbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.466634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef073e-c611-46a8-964b-c35de66fcbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.466916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef073e-c611-46a8-964b-c35de66fcbe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.467565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef073e-c611-46a8-964b-c35de66fcbe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.470055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef073e-c611-46a8-964b-c35de66fcbe8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.490288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 847/1663] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:38.502516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2516b-4794-4e74-af82-9a220d4720bb None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.506324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1fc2516b-4794-4e74-af82-9a220d4720bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:38.516335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 817/1664] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:38 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:38.520415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef073e-c611-46a8-964b-c35de66fcbe8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.532372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef073e-c611-46a8-964b-c35de66fcbe8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.539859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbacfb-1374-4b6a-ab86-1cc062b262ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.540564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbacfb-1374-4b6a-ab86-1cc062b262ce admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.540957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbacfb-1374-4b6a-ab86-1cc062b262ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.541349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbacfb-1374-4b6a-ab86-1cc062b262ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.542128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbacfb-1374-4b6a-ab86-1cc062b262ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.544040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbacfb-1374-4b6a-ab86-1cc062b262ce admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.558064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 818/1665] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:38.563217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbacfb-1374-4b6a-ab86-1cc062b262ce admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.582214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbacfb-1374-4b6a-ab86-1cc062b262ce admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.588588 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728c6b7-ea2f-4e3e-aa2f-532496e60407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.589399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c6b7-ea2f-4e3e-aa2f-532496e60407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.589683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c6b7-ea2f-4e3e-aa2f-532496e60407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.590061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c6b7-ea2f-4e3e-aa2f-532496e60407 admin admin] PATH_INFO: `/v3/projects/0a860b380c5441988c30f68e763fd49b/users/e625542cf2624f6493936ca4c8551a25/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.596325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2516b-4794-4e74-af82-9a220d4720bb None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.601628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b662dc3-6718-4981-942c-7e2de4fd9ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.602469 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662dc3-6718-4981-942c-7e2de4fd9ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.602858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662dc3-6718-4981-942c-7e2de4fd9ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.603205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662dc3-6718-4981-942c-7e2de4fd9ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.616111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b662dc3-6718-4981-942c-7e2de4fd9ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.616349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728c6b7-ea2f-4e3e-aa2f-532496e60407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a860b380c5441988c30f68e763fd49b, user_id=e625542cf2624f6493936ca4c8551a25, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.617756 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b662dc3-6718-4981-942c-7e2de4fd9ae5 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.619016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728c6b7-ea2f-4e3e-aa2f-532496e60407 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.631491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 848/1666] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:38.645589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 819/1667] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:38 2022] PUT /identity/v3/projects/0a860b380c5441988c30f68e763fd49b/users/e625542cf2624f6493936ca4c8551a25/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:38.649406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b662dc3-6718-4981-942c-7e2de4fd9ae5 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.665843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b662dc3-6718-4981-942c-7e2de4fd9ae5 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.705024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:38.768594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa5918-3dab-4c31-8311-491d3135bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.769260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa5918-3dab-4c31-8311-491d3135bc4c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.769543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa5918-3dab-4c31-8311-491d3135bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.769845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa5918-3dab-4c31-8311-491d3135bc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.770488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa5918-3dab-4c31-8311-491d3135bc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.772194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa5918-3dab-4c31-8311-491d3135bc4c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.785596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 849/1668] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:38.789523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728c6b7-ea2f-4e3e-aa2f-532496e60407 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:38.808435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728c6b7-ea2f-4e3e-aa2f-532496e60407 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:38.814698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d7ee2-5dec-4565-8c6e-990596401674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:38.815414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d7ee2-5dec-4565-8c6e-990596401674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.815700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d7ee2-5dec-4565-8c6e-990596401674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.815979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d7ee2-5dec-4565-8c6e-990596401674 admin admin] PATH_INFO: `/v3/projects/0a860b380c5441988c30f68e763fd49b/users/e625542cf2624f6493936ca4c8551a25/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.818607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d7ee2-5dec-4565-8c6e-990596401674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a860b380c5441988c30f68e763fd49b, user_id=e625542cf2624f6493936ca4c8551a25, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:38.822416 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d7ee2-5dec-4565-8c6e-990596401674 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:38.837981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 820/1669] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:38 2022] PUT /identity/v3/projects/0a860b380c5441988c30f68e763fd49b/users/e625542cf2624f6493936ca4c8551a25/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:38.849244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbc7e1-3bb7-4718-8663-7805e3d2ba22 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:38.849867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbc7e1-3bb7-4718-8663-7805e3d2ba22 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:38.850362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbc7e1-3bb7-4718-8663-7805e3d2ba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:38.900206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d9cbc7e1-3bb7-4718-8663-7805e3d2ba22 None None] MFA Rules not processed for user `e625542cf2624f6493936ca4c8551a25`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:38.901866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d9cbc7e1-3bb7-4718-8663-7805e3d2ba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:39.104101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 850/1670] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:39.154771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d7ee2-5dec-4565-8c6e-990596401674 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:39.225417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:39.242730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d7ee2-5dec-4565-8c6e-990596401674 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:39.247874 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e06b0-3b90-4ade-aa03-f3374b5a9970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:39.249125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e06b0-3b90-4ade-aa03-f3374b5a9970 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:39.249621 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e06b0-3b90-4ade-aa03-f3374b5a9970 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:39.249928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e06b0-3b90-4ade-aa03-f3374b5a9970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:39.330163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e06b0-3b90-4ade-aa03-f3374b5a9970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:39.331782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e06b0-3b90-4ade-aa03-f3374b5a9970 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:39.344071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 821/1671] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:39.790250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbc7e1-3bb7-4718-8663-7805e3d2ba22 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:39.933559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbc7e1-3bb7-4718-8663-7805e3d2ba22 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:39.941296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:39.942376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:39.942654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:39.943077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] PATH_INFO: `/v3/users/e1b7029fc33b42e489b2f8d64a51225f` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:39.945144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b7029fc33b42e489b2f8d64a51225f)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:39.947669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:40.007142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b7029fc33b42e489b2f8d64a51225f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.009823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:40.016126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b7029fc33b42e489b2f8d64a51225f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.035010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b7029fc33b42e489b2f8d64a51225f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.035010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b7029fc33b42e489b2f8d64a51225f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.056112 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b7029fc33b42e489b2f8d64a51225f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.070649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 851/1672] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:39 2022] DELETE /identity/v3/users/e1b7029fc33b42e489b2f8d64a51225f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:40.075206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f835-a497-45b7-837d-003c3b15b7b5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:40.075499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f835-a497-45b7-837d-003c3b15b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:40.075773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f835-a497-45b7-837d-003c3b15b7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:40.108206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b2b6f835-a497-45b7-837d-003c3b15b7b5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:40.110064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b2b6f835-a497-45b7-837d-003c3b15b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:40.198882 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 822/1673] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:40.209652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:40.211243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:40.275716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18982f6-935f-45b7-b5fb-49aaf59a2b91 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:40.279564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e10c6-485b-459a-a1a3-1f64eae2cf35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:40.280242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e10c6-485b-459a-a1a3-1f64eae2cf35 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:40.280515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e10c6-485b-459a-a1a3-1f64eae2cf35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:40.280786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e10c6-485b-459a-a1a3-1f64eae2cf35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:40.291651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e10c6-485b-459a-a1a3-1f64eae2cf35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:40.293148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e10c6-485b-459a-a1a3-1f64eae2cf35 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:40.303408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 852/1674] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:40.730864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f835-a497-45b7-837d-003c3b15b7b5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:40.732553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b2b6f835-a497-45b7-837d-003c3b15b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:40.744400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e10c6-485b-459a-a1a3-1f64eae2cf35 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:40.746644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-922e10c6-485b-459a-a1a3-1f64eae2cf35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:40.754949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f835-a497-45b7-837d-003c3b15b7b5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:40.760259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:40.760920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:40.761201 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:40.761575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] PATH_INFO: `/v3/projects/c2e2fa8c4cec4e82b974ef9a04927334` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:40.761917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e10c6-485b-459a-a1a3-1f64eae2cf35 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:40.762626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e2fa8c4cec4e82b974ef9a04927334)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:40.764608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:40.767325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:40.767964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:40.768301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:40.768569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] PATH_INFO: `/v3/users/3cfa80e7838848bc923bdbdda1762b9a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:40.769695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfa80e7838848bc923bdbdda1762b9a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:40.771929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:40.824993 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfa80e7838848bc923bdbdda1762b9a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.839714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfa80e7838848bc923bdbdda1762b9a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.851612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfa80e7838848bc923bdbdda1762b9a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.852627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfa80e7838848bc923bdbdda1762b9a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.872044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-93109193-8e94-4018-94d2-9f50095b98bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfa80e7838848bc923bdbdda1762b9a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:40.879699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 853/1675] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:40 2022] DELETE /identity/v3/users/3cfa80e7838848bc923bdbdda1762b9a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:40.884849 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b519-0c60-4384-ad17-2185c8a8ddc0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:40.885123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b519-0c60-4384-ad17-2185c8a8ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:40.885397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b519-0c60-4384-ad17-2185c8a8ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:40.915262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-62a8b519-0c60-4384-ad17-2185c8a8ddc0 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:40.917733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-62a8b519-0c60-4384-ad17-2185c8a8ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:40.978747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:40.991508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e2fa8c4cec4e82b974ef9a04927334', 'request_id': 'req-04ba4a35-0033-429f-937c-c43d19ab1263'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.006924 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e2fa8c4cec4e82b974ef9a04927334', 'request_id': 'req-04ba4a35-0033-429f-937c-c43d19ab1263'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.014656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e2fa8c4cec4e82b974ef9a04927334', 'request_id': 'req-04ba4a35-0033-429f-937c-c43d19ab1263'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.023387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 854/1676] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:41.028769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] The token cache is being invalidate because project c2e2fa8c4cec4e82b974ef9a04927334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:41.029128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.030206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.032258 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 823/1677] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:40 2022] DELETE /identity/v3/projects/c2e2fa8c4cec4e82b974ef9a04927334 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:41.035856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:41.036003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8b519-0c60-4384-ad17-2185c8a8ddc0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:41.037237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:41.037628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-62a8b519-0c60-4384-ad17-2185c8a8ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:41.064147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:41.148439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba4a35-0033-429f-937c-c43d19ab1263 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:41.150753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8b519-0c60-4384-ad17-2185c8a8ddc0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:41.156965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:41.157875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:41.158351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:41.158890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] PATH_INFO: `/v3/users/629e31fe299c4ab98f645364a92731b9` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:41.160538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=629e31fe299c4ab98f645364a92731b9)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:41.163002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:41.209432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:41.210241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:41.210558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:41.210843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:41.212824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:41.236848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:41.240427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:41.252151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629e31fe299c4ab98f645364a92731b9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.253481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 855/1678] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:41.254272 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:41.255793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:41.260690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629e31fe299c4ab98f645364a92731b9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.280562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629e31fe299c4ab98f645364a92731b9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.291286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629e31fe299c4ab98f645364a92731b9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.292289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629e31fe299c4ab98f645364a92731b9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.301037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 824/1679] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:41 2022] DELETE /identity/v3/users/629e31fe299c4ab98f645364a92731b9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:41.357824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70d426-9544-438e-8cb6-3c80e565b293 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:41.421987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04d3c9-6d0f-4887-8ba1-ab51b956886d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:41.422989 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04d3c9-6d0f-4887-8ba1-ab51b956886d service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:41.423336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04d3c9-6d0f-4887-8ba1-ab51b956886d service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:41.426666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04d3c9-6d0f-4887-8ba1-ab51b956886d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:41.429279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cf04d3c9-6d0f-4887-8ba1-ab51b956886d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:41.450342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:41.525687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04d3c9-6d0f-4887-8ba1-ab51b956886d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:41.527337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04d3c9-6d0f-4887-8ba1-ab51b956886d service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:41.540080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 856/1680] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:41.652756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:41.654594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:41.799264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4606eeb-7a79-4d06-8714-fabc9c210f27 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:41.805064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:41.805856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:41.806335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:41.806615 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] PATH_INFO: `/v3/projects/a8f3116d14734d7b864aca3f8b129c7b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:41.808449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f3116d14734d7b864aca3f8b129c7b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:41.810499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:41.903021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:41.922423 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f3116d14734d7b864aca3f8b129c7b', 'request_id': 'req-97ee6527-1184-4d26-a1ca-71a654258b85'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.938543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f3116d14734d7b864aca3f8b129c7b', 'request_id': 'req-97ee6527-1184-4d26-a1ca-71a654258b85'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.952441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f3116d14734d7b864aca3f8b129c7b', 'request_id': 'req-97ee6527-1184-4d26-a1ca-71a654258b85'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.968786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] The token cache is being invalidate because project a8f3116d14734d7b864aca3f8b129c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:41.969139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.969983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:41.971372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 825/1681] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:41 2022] DELETE /identity/v3/projects/a8f3116d14734d7b864aca3f8b129c7b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:41.975696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04d3c9-6d0f-4887-8ba1-ab51b956886d service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:41.986771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04d3c9-6d0f-4887-8ba1-ab51b956886d service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:42.053526 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:42.054173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.054460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.054752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] PATH_INFO: `/v3/users/a34c0823c36d43fdbe929f7b3d59c74f` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.055969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34c0823c36d43fdbe929f7b3d59c74f)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:42.057874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:42.090446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:42.092383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:42.109501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee6527-1184-4d26-a1ca-71a654258b85 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:42.126886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34c0823c36d43fdbe929f7b3d59c74f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.137118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:42.138248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.138592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.139055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] PATH_INFO: `/v3/projects/9b86992ea63543d8abe87bde0067ea31` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.141492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b86992ea63543d8abe87bde0067ea31)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:42.144163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:42.144453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34c0823c36d43fdbe929f7b3d59c74f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.157333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34c0823c36d43fdbe929f7b3d59c74f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.159671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34c0823c36d43fdbe929f7b3d59c74f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.184040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a1f038f0-d777-4461-8d8a-e0fdd06b6275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34c0823c36d43fdbe929f7b3d59c74f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.203985 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 857/1682] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:41 2022] DELETE /identity/v3/users/a34c0823c36d43fdbe929f7b3d59c74f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:42.231225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b86992ea63543d8abe87bde0067ea31', 'request_id': 'req-bd0de7e6-029b-4a3d-b076-544c2d98b791'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.237977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b86992ea63543d8abe87bde0067ea31', 'request_id': 'req-bd0de7e6-029b-4a3d-b076-544c2d98b791'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.246518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b86992ea63543d8abe87bde0067ea31', 'request_id': 'req-bd0de7e6-029b-4a3d-b076-544c2d98b791'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.264650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] The token cache is being invalidate because project 9b86992ea63543d8abe87bde0067ea31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:42.265311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.265994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:42.268908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 826/1683] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:42 2022] DELETE /identity/v3/projects/9b86992ea63543d8abe87bde0067ea31 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:42.273625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db86979-17fd-4e6e-9067-6668e1fd1b0e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.273919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db86979-17fd-4e6e-9067-6668e1fd1b0e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.274200 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db86979-17fd-4e6e-9067-6668e1fd1b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.312299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9db86979-17fd-4e6e-9067-6668e1fd1b0e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:42.313948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9db86979-17fd-4e6e-9067-6668e1fd1b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:42.351546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:42.438916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:42.440480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:42.444622 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 858/1684] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:42.452610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380eeb7-0219-40d9-84c5-487922b8b52e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.452862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380eeb7-0219-40d9-84c5-487922b8b52e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.453199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380eeb7-0219-40d9-84c5-487922b8b52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.498654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3380eeb7-0219-40d9-84c5-487922b8b52e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:42.500482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3380eeb7-0219-40d9-84c5-487922b8b52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:42.517418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 859/1685] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:42.519661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380eeb7-0219-40d9-84c5-487922b8b52e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:42.532772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380eeb7-0219-40d9-84c5-487922b8b52e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:42.539980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7297da-f7cd-4a7a-9c05-ce60c3df8ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:42.540905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7297da-f7cd-4a7a-9c05-ce60c3df8ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.541284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7297da-f7cd-4a7a-9c05-ce60c3df8ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.541826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7297da-f7cd-4a7a-9c05-ce60c3df8ec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.542846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7297da-f7cd-4a7a-9c05-ce60c3df8ec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:42.543255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7297da-f7cd-4a7a-9c05-ce60c3df8ec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:42.545018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0de7e6-029b-4a3d-b076-544c2d98b791 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:42.546153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7297da-f7cd-4a7a-9c05-ce60c3df8ec6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:42.550654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:42.552047 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.552473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.553043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.555259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:42.565783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 860/1686] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:42.571604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7297da-f7cd-4a7a-9c05-ce60c3df8ec6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:42.586238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7297da-f7cd-4a7a-9c05-ce60c3df8ec6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:42.594001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5f005-0f87-490a-8d4e-4702ae33405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:42.595618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5f005-0f87-490a-8d4e-4702ae33405e admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.596007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5f005-0f87-490a-8d4e-4702ae33405e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.596871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5f005-0f87-490a-8d4e-4702ae33405e admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.597739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5f005-0f87-490a-8d4e-4702ae33405e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:42.600721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5f005-0f87-490a-8d4e-4702ae33405e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:42.647041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 861/1687] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:42 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:42.649479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5f005-0f87-490a-8d4e-4702ae33405e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:42.652292 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:42.654988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:42.683660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 827/1688] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:42.731692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:42.735404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:42.765937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:42.781516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41d8a-2f43-4ba4-8444-c9462262012b service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:42.830839 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5f005-0f87-490a-8d4e-4702ae33405e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:42.838778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e94828-b6da-4dc8-8f8f-9d061e9bc8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:42.840230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e94828-b6da-4dc8-8f8f-9d061e9bc8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.840740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e94828-b6da-4dc8-8f8f-9d061e9bc8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.841155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e94828-b6da-4dc8-8f8f-9d061e9bc8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.842665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e94828-b6da-4dc8-8f8f-9d061e9bc8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:42.844766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e94828-b6da-4dc8-8f8f-9d061e9bc8f3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:42.871862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 862/1689] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:42 2022] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:42.876454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e94828-b6da-4dc8-8f8f-9d061e9bc8f3 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:42.888498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e94828-b6da-4dc8-8f8f-9d061e9bc8f3 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:42.904892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa99c3-c55e-4dbd-b89c-1558184b1d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:42.905562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa99c3-c55e-4dbd-b89c-1558184b1d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.905844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa99c3-c55e-4dbd-b89c-1558184b1d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.906120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa99c3-c55e-4dbd-b89c-1558184b1d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.906858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa99c3-c55e-4dbd-b89c-1558184b1d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:42.908612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa99c3-c55e-4dbd-b89c-1558184b1d89 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:42.915233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:42.916646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.917256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.917822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] PATH_INFO: `/v3/projects/3e6463074f1d47738a1aed866d960819` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.919278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6463074f1d47738a1aed866d960819)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:42.920463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 863/1690] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:42.921550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:42.925838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa99c3-c55e-4dbd-b89c-1558184b1d89 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:42.967853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa99c3-c55e-4dbd-b89c-1558184b1d89 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:42.981023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0ffd-0c70-424f-837e-4d747ee6e5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:42.983356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0ffd-0c70-424f-837e-4d747ee6e5eb admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:42.983958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0ffd-0c70-424f-837e-4d747ee6e5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:42.984510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0ffd-0c70-424f-837e-4d747ee6e5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:42.985756 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce0ffd-0c70-424f-837e-4d747ee6e5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:42.988451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce0ffd-0c70-424f-837e-4d747ee6e5eb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.013453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 864/1691] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:43.014633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0ffd-0c70-424f-837e-4d747ee6e5eb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.026168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0ffd-0c70-424f-837e-4d747ee6e5eb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.035060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6463074f1d47738a1aed866d960819', 'request_id': 'req-0164b9b5-d643-4a35-a2e7-bc97c53e9196'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:43.046777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6463074f1d47738a1aed866d960819', 'request_id': 'req-0164b9b5-d643-4a35-a2e7-bc97c53e9196'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:43.057538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6463074f1d47738a1aed866d960819', 'request_id': 'req-0164b9b5-d643-4a35-a2e7-bc97c53e9196'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:43.073981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] The token cache is being invalidate because project 3e6463074f1d47738a1aed866d960819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:43.074303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:43.074973 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0164b9b5-d643-4a35-a2e7-bc97c53e9196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:43.076508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 828/1692] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:42 2022] DELETE /identity/v3/projects/3e6463074f1d47738a1aed866d960819 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:43.081250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513379da-add8-4a48-aaf0-734ae93a3174 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.081539 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513379da-add8-4a48-aaf0-734ae93a3174 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.081818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513379da-add8-4a48-aaf0-734ae93a3174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.105407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:43.109002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-513379da-add8-4a48-aaf0-734ae93a3174 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:43.110997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-513379da-add8-4a48-aaf0-734ae93a3174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:43.115203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee91ff-2d72-4f07-9469-0a9090e57e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.116408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee91ff-2d72-4f07-9469-0a9090e57e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.116958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee91ff-2d72-4f07-9469-0a9090e57e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.117370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee91ff-2d72-4f07-9469-0a9090e57e2e admin admin] PATH_INFO: `/v3/projects/80e94c19491c46a2aad9c9c3274366de/users/f6d69b08fa124f9f88fa821867334f59/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.124091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 829/1693] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:43.139922 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee91ff-2d72-4f07-9469-0a9090e57e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e94c19491c46a2aad9c9c3274366de, user_id=f6d69b08fa124f9f88fa821867334f59, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.141338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9ee8-0327-44a0-ac9f-d214678b11ea None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.141894 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9ee8-0327-44a0-ac9f-d214678b11ea None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.141979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9ee8-0327-44a0-ac9f-d214678b11ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.144655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee91ff-2d72-4f07-9469-0a9090e57e2e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.164923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 865/1694] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:43 2022] PUT /identity/v3/projects/80e94c19491c46a2aad9c9c3274366de/users/f6d69b08fa124f9f88fa821867334f59/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:43.167137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7b3d9ee8-0327-44a0-ac9f-d214678b11ea None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:43.168470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7b3d9ee8-0327-44a0-ac9f-d214678b11ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:43.177528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc523a0-61b4-4af2-a842-1b4982494be3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.177838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc523a0-61b4-4af2-a842-1b4982494be3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.178145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc523a0-61b4-4af2-a842-1b4982494be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.217029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2bc523a0-61b4-4af2-a842-1b4982494be3 None None] MFA Rules not processed for user `f6d69b08fa124f9f88fa821867334f59`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:43.218534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2bc523a0-61b4-4af2-a842-1b4982494be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:43.276916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 830/1695] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:43.280435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d9ee8-0327-44a0-ac9f-d214678b11ea None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.293038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d9ee8-0327-44a0-ac9f-d214678b11ea None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.305155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffee3fc-5522-4450-8ee1-4fd6120d139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.306104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffee3fc-5522-4450-8ee1-4fd6120d139b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.306555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffee3fc-5522-4450-8ee1-4fd6120d139b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.306988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffee3fc-5522-4450-8ee1-4fd6120d139b admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.307775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffee3fc-5522-4450-8ee1-4fd6120d139b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:43.308212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffee3fc-5522-4450-8ee1-4fd6120d139b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.314008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffee3fc-5522-4450-8ee1-4fd6120d139b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.319569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 866/1696] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:43.324167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc523a0-61b4-4af2-a842-1b4982494be3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.326256 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2bc523a0-61b4-4af2-a842-1b4982494be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:43.340459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc523a0-61b4-4af2-a842-1b4982494be3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.341753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 831/1697] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:43.345856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffee3fc-5522-4450-8ee1-4fd6120d139b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.355896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850c720-d074-42f9-ba9e-4528883526c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.356542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c720-d074-42f9-ba9e-4528883526c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.356926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c720-d074-42f9-ba9e-4528883526c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.357373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c720-d074-42f9-ba9e-4528883526c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.358176 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850c720-d074-42f9-ba9e-4528883526c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.360440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850c720-d074-42f9-ba9e-4528883526c4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.367383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffee3fc-5522-4450-8ee1-4fd6120d139b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.374127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456def-6664-425b-b110-dd1a3ca6d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.375313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456def-6664-425b-b110-dd1a3ca6d625 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.375737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456def-6664-425b-b110-dd1a3ca6d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.376197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456def-6664-425b-b110-dd1a3ca6d625 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.376965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456def-6664-425b-b110-dd1a3ca6d625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.379673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456def-6664-425b-b110-dd1a3ca6d625 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.395506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:43.398450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 867/1698] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:43 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:43.404217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850c720-d074-42f9-ba9e-4528883526c4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.449201 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 832/1699] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:43 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:43.453820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456def-6664-425b-b110-dd1a3ca6d625 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.514048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850c720-d074-42f9-ba9e-4528883526c4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.644640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456def-6664-425b-b110-dd1a3ca6d625 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.654750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577954e-4224-472e-9dc2-f68cb6c650c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.655971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577954e-4224-472e-9dc2-f68cb6c650c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.656225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577954e-4224-472e-9dc2-f68cb6c650c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.656624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577954e-4224-472e-9dc2-f68cb6c650c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.657839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577954e-4224-472e-9dc2-f68cb6c650c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.660136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577954e-4224-472e-9dc2-f68cb6c650c1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.665598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:43.700987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d8b94-651e-4903-95ab-24ef95ffc6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.701322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 833/1700] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:43 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:43.704501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8b94-651e-4903-95ab-24ef95ffc6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.704501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8b94-651e-4903-95ab-24ef95ffc6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.704501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8b94-651e-4903-95ab-24ef95ffc6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.704501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d8b94-651e-4903-95ab-24ef95ffc6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.705556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577954e-4224-472e-9dc2-f68cb6c650c1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.706087 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d8b94-651e-4903-95ab-24ef95ffc6d0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.719643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577954e-4224-472e-9dc2-f68cb6c650c1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.734739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657392d4-d58f-4e73-aae7-e5add59df836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.735822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657392d4-d58f-4e73-aae7-e5add59df836 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.736259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657392d4-d58f-4e73-aae7-e5add59df836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.736670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657392d4-d58f-4e73-aae7-e5add59df836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.737935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657392d4-d58f-4e73-aae7-e5add59df836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.740638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657392d4-d58f-4e73-aae7-e5add59df836 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.745834 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 868/1701] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:43 2022] POST /identity/v3/users => generated 296 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:43.749924 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d8b94-651e-4903-95ab-24ef95ffc6d0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.761548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d8b94-651e-4903-95ab-24ef95ffc6d0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.767862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49f973-1bb1-42fb-9ae7-2b333866564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.768569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49f973-1bb1-42fb-9ae7-2b333866564f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.768892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49f973-1bb1-42fb-9ae7-2b333866564f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.769140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49f973-1bb1-42fb-9ae7-2b333866564f admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.769915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49f973-1bb1-42fb-9ae7-2b333866564f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.770896 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 834/1702] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:43.771984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49f973-1bb1-42fb-9ae7-2b333866564f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.775267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657392d4-d58f-4e73-aae7-e5add59df836 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.786934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 869/1703] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:43.787529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657392d4-d58f-4e73-aae7-e5add59df836 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.791233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49f973-1bb1-42fb-9ae7-2b333866564f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.792632 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77892a9-a2a8-45f1-8d95-dd95b015e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.793323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77892a9-a2a8-45f1-8d95-dd95b015e758 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.793667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77892a9-a2a8-45f1-8d95-dd95b015e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.794189 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77892a9-a2a8-45f1-8d95-dd95b015e758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.794973 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77892a9-a2a8-45f1-8d95-dd95b015e758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.796548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77892a9-a2a8-45f1-8d95-dd95b015e758 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.806043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49f973-1bb1-42fb-9ae7-2b333866564f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.811351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 835/1704] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:43.812485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1814b-2000-447f-a7ea-05c4ccda7266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.813161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1814b-2000-447f-a7ea-05c4ccda7266 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.813445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1814b-2000-447f-a7ea-05c4ccda7266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.813720 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1814b-2000-447f-a7ea-05c4ccda7266 admin admin] PATH_INFO: `/v3/projects/59cd98611b494f678e733e259b6a0667/users/9bbd4587987c47fb8bca12efc74bfb1d/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.815286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77892a9-a2a8-45f1-8d95-dd95b015e758 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.828088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77892a9-a2a8-45f1-8d95-dd95b015e758 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:43.832256 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1814b-2000-447f-a7ea-05c4ccda7266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cd98611b494f678e733e259b6a0667, user_id=9bbd4587987c47fb8bca12efc74bfb1d, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.833105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f302f3-c0e3-4cf0-b3d7-458d72b03679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:43.833869 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f302f3-c0e3-4cf0-b3d7-458d72b03679 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.834224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f302f3-c0e3-4cf0-b3d7-458d72b03679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.834563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f302f3-c0e3-4cf0-b3d7-458d72b03679 admin admin] PATH_INFO: `/v3/projects/f5707f1775a7469586519cd83fba8ee8/users/d2f59ba856594984b35b9e86bf6a4f97/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.835062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1814b-2000-447f-a7ea-05c4ccda7266 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.853280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f302f3-c0e3-4cf0-b3d7-458d72b03679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5707f1775a7469586519cd83fba8ee8, user_id=d2f59ba856594984b35b9e86bf6a4f97, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:43.857023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f302f3-c0e3-4cf0-b3d7-458d72b03679 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:43.861051 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 870/1705] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:43 2022] PUT /identity/v3/projects/59cd98611b494f678e733e259b6a0667/users/9bbd4587987c47fb8bca12efc74bfb1d/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:43.862170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1814b-2000-447f-a7ea-05c4ccda7266 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:43.882885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 836/1706] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:43 2022] PUT /identity/v3/projects/f5707f1775a7469586519cd83fba8ee8/users/d2f59ba856594984b35b9e86bf6a4f97/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:43.891152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea972b7-5b2d-410c-ac1a-f6cfe7e319f5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:43.891655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea972b7-5b2d-410c-ac1a-f6cfe7e319f5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:43.892050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea972b7-5b2d-410c-ac1a-f6cfe7e319f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:43.932694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9ea972b7-5b2d-410c-ac1a-f6cfe7e319f5 None None] MFA Rules not processed for user `d2f59ba856594984b35b9e86bf6a4f97`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:43.933901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9ea972b7-5b2d-410c-ac1a-f6cfe7e319f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:43.944138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1814b-2000-447f-a7ea-05c4ccda7266 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:44.063868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bd022-e306-41e3-9d5b-fca1ba0ccc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:44.071885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bd022-e306-41e3-9d5b-fca1ba0ccc5b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.072630 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bd022-e306-41e3-9d5b-fca1ba0ccc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.073341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bd022-e306-41e3-9d5b-fca1ba0ccc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.074547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bd022-e306-41e3-9d5b-fca1ba0ccc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:44.076451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bd022-e306-41e3-9d5b-fca1ba0ccc5b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:44.092316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 871/1707] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:44.098991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bd022-e306-41e3-9d5b-fca1ba0ccc5b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:44.115609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 837/1708] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:44.120796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bd022-e306-41e3-9d5b-fca1ba0ccc5b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:44.121579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea972b7-5b2d-410c-ac1a-f6cfe7e319f5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:44.129553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d88dab-89a3-4a48-8b87-d67ae80a9399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:44.130576 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88dab-89a3-4a48-8b87-d67ae80a9399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.131032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88dab-89a3-4a48-8b87-d67ae80a9399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.131577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88dab-89a3-4a48-8b87-d67ae80a9399 admin admin] PATH_INFO: `/v3/projects/59cd98611b494f678e733e259b6a0667/users/9bbd4587987c47fb8bca12efc74bfb1d/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.136473 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d88dab-89a3-4a48-8b87-d67ae80a9399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cd98611b494f678e733e259b6a0667, user_id=9bbd4587987c47fb8bca12efc74bfb1d, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:44.143747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d88dab-89a3-4a48-8b87-d67ae80a9399 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:44.166911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 872/1709] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:44 2022] PUT /identity/v3/projects/59cd98611b494f678e733e259b6a0667/users/9bbd4587987c47fb8bca12efc74bfb1d/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:44.170877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea972b7-5b2d-410c-ac1a-f6cfe7e319f5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:44.172663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1620c-8a79-4089-b7a0-c69a07163d8b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.174352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1620c-8a79-4089-b7a0-c69a07163d8b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.174642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1620c-8a79-4089-b7a0-c69a07163d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.212958 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:44.255808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-70e1620c-8a79-4089-b7a0-c69a07163d8b None None] MFA Rules not processed for user `9bbd4587987c47fb8bca12efc74bfb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:44.257086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-70e1620c-8a79-4089-b7a0-c69a07163d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:44.282263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d2b2-d045-459b-966d-6b158766a0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:44.285084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d2b2-d045-459b-966d-6b158766a0af admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.285675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d2b2-d045-459b-966d-6b158766a0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.286606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d2b2-d045-459b-966d-6b158766a0af admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.288649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13d2b2-d045-459b-966d-6b158766a0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:44.291489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13d2b2-d045-459b-966d-6b158766a0af admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:44.334479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:44.382208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 838/1710] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:44 2022] POST /identity/v3/projects => generated 399 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:44.386582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d2b2-d045-459b-966d-6b158766a0af admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:44.447490 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 873/1711] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:44.463771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1620c-8a79-4089-b7a0-c69a07163d8b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:44.465482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-70e1620c-8a79-4089-b7a0-c69a07163d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:44.535758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d2b2-d045-459b-966d-6b158766a0af admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:44.548209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb27a38-9704-4d61-b7ac-2bbc53f5a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:44.549697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb27a38-9704-4d61-b7ac-2bbc53f5a044 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.550060 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb27a38-9704-4d61-b7ac-2bbc53f5a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.550319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb27a38-9704-4d61-b7ac-2bbc53f5a044 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.551586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb27a38-9704-4d61-b7ac-2bbc53f5a044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:44.553826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb27a38-9704-4d61-b7ac-2bbc53f5a044 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:44.588363 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1620c-8a79-4089-b7a0-c69a07163d8b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:44.588544 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 839/1712] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:44 2022] POST /identity/v3/users => generated 306 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:44.589752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb27a38-9704-4d61-b7ac-2bbc53f5a044 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:44.604354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb27a38-9704-4d61-b7ac-2bbc53f5a044 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:44.610105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ac61c-e7e4-4f0c-8880-88c40efaae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:44.610935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ac61c-e7e4-4f0c-8880-88c40efaae2f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.611324 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ac61c-e7e4-4f0c-8880-88c40efaae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.611654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ac61c-e7e4-4f0c-8880-88c40efaae2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.612407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ac61c-e7e4-4f0c-8880-88c40efaae2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:44.614477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ac61c-e7e4-4f0c-8880-88c40efaae2f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:44.631013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 840/1713] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:44.632038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ac61c-e7e4-4f0c-8880-88c40efaae2f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:44.650485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ac61c-e7e4-4f0c-8880-88c40efaae2f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:44.657400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d1d7-1281-4e31-b60c-875208d42731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:44.658075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d1d7-1281-4e31-b60c-875208d42731 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.658402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d1d7-1281-4e31-b60c-875208d42731 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.658681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d1d7-1281-4e31-b60c-875208d42731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.660979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebc805-e34a-47df-a7af-e5874ef8ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:44.662353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc805-e34a-47df-a7af-e5874ef8ee12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.662840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc805-e34a-47df-a7af-e5874ef8ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.663348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc805-e34a-47df-a7af-e5874ef8ee12 admin admin] PATH_INFO: `/v3/projects/59974172a2f349c8acff8a3063ef0edb/users/4989d106f89a4a7aa1b4fab2303c1972/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.684748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc805-e34a-47df-a7af-e5874ef8ee12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59974172a2f349c8acff8a3063ef0edb, user_id=4989d106f89a4a7aa1b4fab2303c1972, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:44.687679 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc805-e34a-47df-a7af-e5874ef8ee12 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:44.706844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 841/1714] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:44 2022] PUT /identity/v3/projects/59974172a2f349c8acff8a3063ef0edb/users/4989d106f89a4a7aa1b4fab2303c1972/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:44.710153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebc805-e34a-47df-a7af-e5874ef8ee12 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:44.746507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65d1d7-1281-4e31-b60c-875208d42731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:44.748719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65d1d7-1281-4e31-b60c-875208d42731 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:44.762184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 874/1715] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:44.805579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebc805-e34a-47df-a7af-e5874ef8ee12 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:44.811653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d4ebd-e75e-4d47-88ec-16d26ae3be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:44.812280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d4ebd-e75e-4d47-88ec-16d26ae3be9c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.812630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d4ebd-e75e-4d47-88ec-16d26ae3be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.812911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d4ebd-e75e-4d47-88ec-16d26ae3be9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.814297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d4ebd-e75e-4d47-88ec-16d26ae3be9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:44.817104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d4ebd-e75e-4d47-88ec-16d26ae3be9c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:44.823615 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:44.844205 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d1d7-1281-4e31-b60c-875208d42731 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:44.847400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 842/1716] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:44.860539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d1d7-1281-4e31-b60c-875208d42731 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:44.868949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ac40-3102-4b1c-8ba2-03582a2f4d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:44.869906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ac40-3102-4b1c-8ba2-03582a2f4d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.870302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ac40-3102-4b1c-8ba2-03582a2f4d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.871135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ac40-3102-4b1c-8ba2-03582a2f4d73 admin admin] PATH_INFO: `/v3/projects/59974172a2f349c8acff8a3063ef0edb/users/4989d106f89a4a7aa1b4fab2303c1972/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.874092 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4ac40-3102-4b1c-8ba2-03582a2f4d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59974172a2f349c8acff8a3063ef0edb, user_id=4989d106f89a4a7aa1b4fab2303c1972, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:44.879081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4ac40-3102-4b1c-8ba2-03582a2f4d73 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:44.897236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 875/1717] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:44 2022] PUT /identity/v3/projects/59974172a2f349c8acff8a3063ef0edb/users/4989d106f89a4a7aa1b4fab2303c1972/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:44.907771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cd030-5053-485d-a1ac-cdc71a1614a4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:44.909089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cd030-5053-485d-a1ac-cdc71a1614a4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:44.909532 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cd030-5053-485d-a1ac-cdc71a1614a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:44.957496 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ac40-3102-4b1c-8ba2-03582a2f4d73 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:44.967734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-825cd030-5053-485d-a1ac-cdc71a1614a4 None None] MFA Rules not processed for user `4989d106f89a4a7aa1b4fab2303c1972`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:44.969751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-825cd030-5053-485d-a1ac-cdc71a1614a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:44.989815 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:45.036109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ac40-3102-4b1c-8ba2-03582a2f4d73 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:45.041410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261f1bd-6139-4d99-a90b-6ee06b5c6e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:45.042226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261f1bd-6139-4d99-a90b-6ee06b5c6e6f service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:45.042653 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261f1bd-6139-4d99-a90b-6ee06b5c6e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:45.043045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261f1bd-6139-4d99-a90b-6ee06b5c6e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:45.084856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 843/1718] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:45.117557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cd030-5053-485d-a1ac-cdc71a1614a4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:45.119281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-825cd030-5053-485d-a1ac-cdc71a1614a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:45.136003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cd030-5053-485d-a1ac-cdc71a1614a4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:45.141664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c376bd-c352-443f-bb8b-35d0777ac784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:45.142462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c376bd-c352-443f-bb8b-35d0777ac784 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:45.142817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261f1bd-6139-4d99-a90b-6ee06b5c6e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:45.143305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c376bd-c352-443f-bb8b-35d0777ac784 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:45.143305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c376bd-c352-443f-bb8b-35d0777ac784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:45.144587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261f1bd-6139-4d99-a90b-6ee06b5c6e6f service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:45.153775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c376bd-c352-443f-bb8b-35d0777ac784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:45.155798 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c376bd-c352-443f-bb8b-35d0777ac784 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:45.156318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 876/1719] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:45.168739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 844/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:45.277313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261f1bd-6139-4d99-a90b-6ee06b5c6e6f service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:45.285094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261f1bd-6139-4d99-a90b-6ee06b5c6e6f service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:45.287199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44d17-ceb8-4b18-b3f7-00b43358bd06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:45.288123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44d17-ceb8-4b18-b3f7-00b43358bd06 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:45.288393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44d17-ceb8-4b18-b3f7-00b43358bd06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:45.288973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44d17-ceb8-4b18-b3f7-00b43358bd06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:45.386424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a44d17-ceb8-4b18-b3f7-00b43358bd06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:45.388401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a44d17-ceb8-4b18-b3f7-00b43358bd06 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:45.419236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 877/1721] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:45.811125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c376bd-c352-443f-bb8b-35d0777ac784 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:45.967334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c376bd-c352-443f-bb8b-35d0777ac784 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:45.974507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:45.975206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:45.975579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:45.975904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] PATH_INFO: `/v3/users/f6d69b08fa124f9f88fa821867334f59` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:45.977583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d69b08fa124f9f88fa821867334f59)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:45.979090 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:46.084670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d69b08fa124f9f88fa821867334f59'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.094313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d69b08fa124f9f88fa821867334f59'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.109792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d69b08fa124f9f88fa821867334f59'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.111535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:46.119984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d69b08fa124f9f88fa821867334f59'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.121232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d69b08fa124f9f88fa821867334f59'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.129830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 845/1722] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:45 2022] DELETE /identity/v3/users/f6d69b08fa124f9f88fa821867334f59 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:46.134524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318f771-a7e1-4bf9-9f2f-ef7b97a00ecb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:46.134865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318f771-a7e1-4bf9-9f2f-ef7b97a00ecb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:46.135151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318f771-a7e1-4bf9-9f2f-ef7b97a00ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:46.167568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9318f771-a7e1-4bf9-9f2f-ef7b97a00ecb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:46.169048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9318f771-a7e1-4bf9-9f2f-ef7b97a00ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:46.253328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 878/1723] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:46.266442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:46.268861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:46.341999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29679-1054-45ad-b0e7-986cbc19e2a9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:46.346053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d6b9c-a974-4a83-8958-4e96c6a27fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:46.346679 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d6b9c-a974-4a83-8958-4e96c6a27fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:46.347000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d6b9c-a974-4a83-8958-4e96c6a27fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:46.347275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d6b9c-a974-4a83-8958-4e96c6a27fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:46.356493 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d6b9c-a974-4a83-8958-4e96c6a27fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:46.357918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d6b9c-a974-4a83-8958-4e96c6a27fc3 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:46.367649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 846/1724] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:46.678416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318f771-a7e1-4bf9-9f2f-ef7b97a00ecb None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:46.679701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9318f771-a7e1-4bf9-9f2f-ef7b97a00ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:46.700938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318f771-a7e1-4bf9-9f2f-ef7b97a00ecb None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:46.729211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:46.730345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:46.730630 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:46.732571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] PATH_INFO: `/v3/projects/80e94c19491c46a2aad9c9c3274366de` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:46.734570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e94c19491c46a2aad9c9c3274366de)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:46.737259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:46.746802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:46.819152 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e94c19491c46a2aad9c9c3274366de', 'request_id': 'req-99cf2846-c116-40c3-bc65-82a4aca2d4f0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.827594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e94c19491c46a2aad9c9c3274366de', 'request_id': 'req-99cf2846-c116-40c3-bc65-82a4aca2d4f0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.841853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e94c19491c46a2aad9c9c3274366de', 'request_id': 'req-99cf2846-c116-40c3-bc65-82a4aca2d4f0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.864826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] The token cache is being invalidate because project 80e94c19491c46a2aad9c9c3274366de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:46.865125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.866492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:46.872465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 879/1725] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:46 2022] DELETE /identity/v3/projects/80e94c19491c46a2aad9c9c3274366de => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:46.874168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d6b9c-a974-4a83-8958-4e96c6a27fc3 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:46.889398 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d6b9c-a974-4a83-8958-4e96c6a27fc3 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:47.000757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:47.001429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:47.001714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:47.001984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] PATH_INFO: `/v3/users/9bbd4587987c47fb8bca12efc74bfb1d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:47.004983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbd4587987c47fb8bca12efc74bfb1d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:47.009130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:47.129784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbd4587987c47fb8bca12efc74bfb1d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.145647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbd4587987c47fb8bca12efc74bfb1d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.168604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbd4587987c47fb8bca12efc74bfb1d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.187828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbd4587987c47fb8bca12efc74bfb1d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.188508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbd4587987c47fb8bca12efc74bfb1d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.203194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 847/1726] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:46 2022] DELETE /identity/v3/users/9bbd4587987c47fb8bca12efc74bfb1d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:47.502489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:47.504001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:47.537304 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf2846-c116-40c3-bc65-82a4aca2d4f0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:47.633938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:47.634774 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:47.635300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:47.635686 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] PATH_INFO: `/v3/users/b3f4232e1bc44bc59bca9104eedbe92c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:47.638373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f4232e1bc44bc59bca9104eedbe92c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:47.641686 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:47.718463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:47.721789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:47.740042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f4232e1bc44bc59bca9104eedbe92c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.744234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187d8f2-43d8-4d16-a776-4d7e14407236 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:47.750957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f4232e1bc44bc59bca9104eedbe92c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.756623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:47.757927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:47.758321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:47.758664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] PATH_INFO: `/v3/projects/59cd98611b494f678e733e259b6a0667` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:47.760883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f4232e1bc44bc59bca9104eedbe92c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.761418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cd98611b494f678e733e259b6a0667)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:47.761660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f4232e1bc44bc59bca9104eedbe92c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.764567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:47.776587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:47.792445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-227eec38-c599-46a1-b1ff-024905da4421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f4232e1bc44bc59bca9104eedbe92c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.799901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 880/1727] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:47 2022] DELETE /identity/v3/users/b3f4232e1bc44bc59bca9104eedbe92c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:47.806196 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490218-bfc3-473a-982b-52da9198ecf1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:47.806568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490218-bfc3-473a-982b-52da9198ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:47.807443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490218-bfc3-473a-982b-52da9198ecf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:47.834617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7b490218-bfc3-473a-982b-52da9198ecf1 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:47.834617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7b490218-bfc3-473a-982b-52da9198ecf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:47.837849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cd98611b494f678e733e259b6a0667', 'request_id': 'req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.851964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:47.856142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cd98611b494f678e733e259b6a0667', 'request_id': 'req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.868631 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cd98611b494f678e733e259b6a0667', 'request_id': 'req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.883638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] The token cache is being invalidate because project 59cd98611b494f678e733e259b6a0667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:47.884241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.884668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-53d16ab0-c9e1-4c8d-90f3-2882ab6c90d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:47.886327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 848/1728] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:47 2022] DELETE /identity/v3/projects/59cd98611b494f678e733e259b6a0667 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:47.891313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1bfc4-b04a-456d-9622-e5805a31f0a5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:47.891693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1bfc4-b04a-456d-9622-e5805a31f0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:47.892049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1bfc4-b04a-456d-9622-e5805a31f0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:47.918731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6ed1bfc4-b04a-456d-9622-e5805a31f0a5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:47.920084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6ed1bfc4-b04a-456d-9622-e5805a31f0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:47.937714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 881/1729] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:47.948844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b490218-bfc3-473a-982b-52da9198ecf1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:47.950563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7b490218-bfc3-473a-982b-52da9198ecf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:48.014119 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 849/1730] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:48.022071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4ba2-b0b2-47a4-94ed-93eb72fde281 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.022414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4ba2-b0b2-47a4-94ed-93eb72fde281 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.022796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4ba2-b0b2-47a4-94ed-93eb72fde281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.025232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b490218-bfc3-473a-982b-52da9198ecf1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.029603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65125-4d2e-48f5-b462-a3e6b4784e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.030453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65125-4d2e-48f5-b462-a3e6b4784e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.030899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65125-4d2e-48f5-b462-a3e6b4784e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.031357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65125-4d2e-48f5-b462-a3e6b4784e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.047738 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65125-4d2e-48f5-b462-a3e6b4784e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.055397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-35ba4ba2-b0b2-47a4-94ed-93eb72fde281 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:48.055397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-35ba4ba2-b0b2-47a4-94ed-93eb72fde281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:48.059799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65125-4d2e-48f5-b462-a3e6b4784e14 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.062672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 850/1731] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:48.066848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4ba2-b0b2-47a4-94ed-93eb72fde281 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.075102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 882/1732] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:48.076120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4ba2-b0b2-47a4-94ed-93eb72fde281 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.081066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c49ed-f03c-429b-9add-13069c7f0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.081686 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c49ed-f03c-429b-9add-13069c7f0c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.082018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c49ed-f03c-429b-9add-13069c7f0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.082204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c49ed-f03c-429b-9add-13069c7f0c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.082917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c49ed-f03c-429b-9add-13069c7f0c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:48.083218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c49ed-f03c-429b-9add-13069c7f0c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.084825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c49ed-f03c-429b-9add-13069c7f0c6b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.097240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 851/1733] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:24:48.101502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65125-4d2e-48f5-b462-a3e6b4784e14 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.111676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65125-4d2e-48f5-b462-a3e6b4784e14 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.116609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc47c49-ee46-41e9-a8f7-9fa9184ab2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.117231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc47c49-ee46-41e9-a8f7-9fa9184ab2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.117509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc47c49-ee46-41e9-a8f7-9fa9184ab2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.117780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc47c49-ee46-41e9-a8f7-9fa9184ab2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.118431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc47c49-ee46-41e9-a8f7-9fa9184ab2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.120356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc47c49-ee46-41e9-a8f7-9fa9184ab2f7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.149391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 883/1734] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:48 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:48.153916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c49ed-f03c-429b-9add-13069c7f0c6b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.169147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c49ed-f03c-429b-9add-13069c7f0c6b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.233563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10eb36-5bec-485e-acc2-f2c8cae0851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.234426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10eb36-5bec-485e-acc2-f2c8cae0851f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.234801 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10eb36-5bec-485e-acc2-f2c8cae0851f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.235141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10eb36-5bec-485e-acc2-f2c8cae0851f admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.235928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10eb36-5bec-485e-acc2-f2c8cae0851f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.238282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10eb36-5bec-485e-acc2-f2c8cae0851f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.264804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 852/1735] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:48 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:48.266454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc47c49-ee46-41e9-a8f7-9fa9184ab2f7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.276823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc47c49-ee46-41e9-a8f7-9fa9184ab2f7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.282382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55264b-d30e-49c5-860c-9444345fb321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.283117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55264b-d30e-49c5-860c-9444345fb321 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.283483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55264b-d30e-49c5-860c-9444345fb321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.283930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55264b-d30e-49c5-860c-9444345fb321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.284589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55264b-d30e-49c5-860c-9444345fb321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.286190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55264b-d30e-49c5-860c-9444345fb321 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.297417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 884/1736] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:48.301670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10eb36-5bec-485e-acc2-f2c8cae0851f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.312782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10eb36-5bec-485e-acc2-f2c8cae0851f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.317768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628b01-58c2-4f97-a03e-10ea43998b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.318550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628b01-58c2-4f97-a03e-10ea43998b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.318961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628b01-58c2-4f97-a03e-10ea43998b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.319316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628b01-58c2-4f97-a03e-10ea43998b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.320125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9628b01-58c2-4f97-a03e-10ea43998b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.321821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9628b01-58c2-4f97-a03e-10ea43998b63 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.323366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:48.340909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 853/1737] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:48.344083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55264b-d30e-49c5-860c-9444345fb321 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.364835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55264b-d30e-49c5-860c-9444345fb321 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.371168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af60937-504e-4d6a-bc8f-dd9923f9154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.371452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60937-504e-4d6a-bc8f-dd9923f9154c admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.371821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60937-504e-4d6a-bc8f-dd9923f9154c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.372150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60937-504e-4d6a-bc8f-dd9923f9154c admin admin] PATH_INFO: `/v3/projects/8a4e34f8910742f79432372e67ec0627/users/dfaebcac1cf244f6b3c02e333868dfb8/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.372253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628b01-58c2-4f97-a03e-10ea43998b63 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.374507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a9628b01-58c2-4f97-a03e-10ea43998b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:48.389863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60937-504e-4d6a-bc8f-dd9923f9154c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4e34f8910742f79432372e67ec0627, user_id=dfaebcac1cf244f6b3c02e333868dfb8, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.392804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60937-504e-4d6a-bc8f-dd9923f9154c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.395098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628b01-58c2-4f97-a03e-10ea43998b63 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.408630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.409304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.409607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.409899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] PATH_INFO: `/v3/projects/151e7f1b0c11466da5ba0617107c6a6f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.410581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 885/1738] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:48 2022] PUT /identity/v3/projects/8a4e34f8910742f79432372e67ec0627/users/dfaebcac1cf244f6b3c02e333868dfb8/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:48.414870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=151e7f1b0c11466da5ba0617107c6a6f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.414870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.422109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476a687-23a5-4936-8d45-0aefb6a8aeb3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.422823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476a687-23a5-4936-8d45-0aefb6a8aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.423168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476a687-23a5-4936-8d45-0aefb6a8aeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.459797 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6476a687-23a5-4936-8d45-0aefb6a8aeb3 None None] MFA Rules not processed for user `dfaebcac1cf244f6b3c02e333868dfb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:48.461258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6476a687-23a5-4936-8d45-0aefb6a8aeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:48.476362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151e7f1b0c11466da5ba0617107c6a6f', 'request_id': 'req-9a71192a-2851-479c-97d4-1c2e81ed7a3b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.485313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151e7f1b0c11466da5ba0617107c6a6f', 'request_id': 'req-9a71192a-2851-479c-97d4-1c2e81ed7a3b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.494451 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151e7f1b0c11466da5ba0617107c6a6f', 'request_id': 'req-9a71192a-2851-479c-97d4-1c2e81ed7a3b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.507095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] The token cache is being invalidate because project 151e7f1b0c11466da5ba0617107c6a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:48.507391 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.508118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.509988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 854/1739] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:48 2022] DELETE /identity/v3/projects/151e7f1b0c11466da5ba0617107c6a6f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:48.513792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.514374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:48.515208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:48.545426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 886/1740] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:48.553545 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476a687-23a5-4936-8d45-0aefb6a8aeb3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.562088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6476a687-23a5-4936-8d45-0aefb6a8aeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:48.617228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71192a-2851-479c-97d4-1c2e81ed7a3b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.623603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.624381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.624970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.625474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] PATH_INFO: `/v3/users/0dcd06e3c7334a71be05d7b82f8ec6ab` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.626990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcd06e3c7334a71be05d7b82f8ec6ab)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.629020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.715402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476a687-23a5-4936-8d45-0aefb6a8aeb3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.729333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cc4b8-4d48-4333-8e6e-fd4c9a642046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.730073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cc4b8-4d48-4333-8e6e-fd4c9a642046 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.730360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cc4b8-4d48-4333-8e6e-fd4c9a642046 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.730904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cc4b8-4d48-4333-8e6e-fd4c9a642046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.737310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcd06e3c7334a71be05d7b82f8ec6ab'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.743951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cc4b8-4d48-4333-8e6e-fd4c9a642046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.745412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cc4b8-4d48-4333-8e6e-fd4c9a642046 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.747808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcd06e3c7334a71be05d7b82f8ec6ab'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.767960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 887/1741] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:48.779528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcd06e3c7334a71be05d7b82f8ec6ab'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.797877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cc4b8-4d48-4333-8e6e-fd4c9a642046 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:48.798962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcd06e3c7334a71be05d7b82f8ec6ab'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.799743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a10cc4b8-4d48-4333-8e6e-fd4c9a642046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:48.799907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b4f57131-a030-4ec9-b940-a897f94e4e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcd06e3c7334a71be05d7b82f8ec6ab'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.802142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:48.817786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 855/1742] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:48 2022] DELETE /identity/v3/users/0dcd06e3c7334a71be05d7b82f8ec6ab => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:48.818010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cc4b8-4d48-4333-8e6e-fd4c9a642046 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.904513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.905482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.905896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.906316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] PATH_INFO: `/v3/users/dfaebcac1cf244f6b3c02e333868dfb8` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.907971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfaebcac1cf244f6b3c02e333868dfb8)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.910388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.967910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfaebcac1cf244f6b3c02e333868dfb8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.977005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfaebcac1cf244f6b3c02e333868dfb8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.985974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfaebcac1cf244f6b3c02e333868dfb8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.986599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfaebcac1cf244f6b3c02e333868dfb8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:48.999396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfaebcac1cf244f6b3c02e333868dfb8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.008892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 888/1743] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:48 2022] DELETE /identity/v3/users/dfaebcac1cf244f6b3c02e333868dfb8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:49.013302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc57859-015d-4245-860a-b69244c27da5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:49.013708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc57859-015d-4245-860a-b69244c27da5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:49.013788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc57859-015d-4245-860a-b69244c27da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:49.034797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7fc57859-015d-4245-860a-b69244c27da5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:49.037690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7fc57859-015d-4245-860a-b69244c27da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:49.112575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 856/1744] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:49.124539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:49.126251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:49.139516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc57859-015d-4245-860a-b69244c27da5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:49.141088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7fc57859-015d-4245-860a-b69244c27da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:49.141620 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:49.161203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc57859-015d-4245-860a-b69244c27da5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:49.166850 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:49.167426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:49.167708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:49.167986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] PATH_INFO: `/v3/projects/040f1e22f7e94a00b046bcee3d9077cc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:49.169284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040f1e22f7e94a00b046bcee3d9077cc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:49.171271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:49.199609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f7b56-4a26-418f-ab5e-fe4e9c3c5605 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:49.204869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727309de-1479-4bd9-8a19-efa3ea00622f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:49.205750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727309de-1479-4bd9-8a19-efa3ea00622f service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:49.206028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727309de-1479-4bd9-8a19-efa3ea00622f service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:49.206300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727309de-1479-4bd9-8a19-efa3ea00622f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:49.217020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727309de-1479-4bd9-8a19-efa3ea00622f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:49.218452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727309de-1479-4bd9-8a19-efa3ea00622f service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:49.228662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040f1e22f7e94a00b046bcee3d9077cc', 'request_id': 'req-a9719ef9-e0aa-40c5-a197-8951ca411ef9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.234015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 889/1745] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:49.239982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040f1e22f7e94a00b046bcee3d9077cc', 'request_id': 'req-a9719ef9-e0aa-40c5-a197-8951ca411ef9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.246903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040f1e22f7e94a00b046bcee3d9077cc', 'request_id': 'req-a9719ef9-e0aa-40c5-a197-8951ca411ef9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.260140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] The token cache is being invalidate because project 040f1e22f7e94a00b046bcee3d9077cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:49.260437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.261118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.262667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 857/1746] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:49 2022] DELETE /identity/v3/projects/040f1e22f7e94a00b046bcee3d9077cc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:49.266926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727309de-1479-4bd9-8a19-efa3ea00622f service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:49.277925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727309de-1479-4bd9-8a19-efa3ea00622f service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:49.345451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:49.346389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:49.346677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:49.346978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] PATH_INFO: `/v3/users/e625542cf2624f6493936ca4c8551a25` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:49.348214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e625542cf2624f6493936ca4c8551a25)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:49.350802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:49.406662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e625542cf2624f6493936ca4c8551a25'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.415964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e625542cf2624f6493936ca4c8551a25'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.423836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e625542cf2624f6493936ca4c8551a25'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.425141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e625542cf2624f6493936ca4c8551a25'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.437809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2469d597-5765-4dfd-bb30-8ff38bf170ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e625542cf2624f6493936ca4c8551a25'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.446939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 890/1747] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:49 2022] DELETE /identity/v3/users/e625542cf2624f6493936ca4c8551a25 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:49.535154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:49.536851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:49.558329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9719ef9-e0aa-40c5-a197-8951ca411ef9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:49.670706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:49.671074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:49.671353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:49.671617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] PATH_INFO: `/v3/projects/8a4e34f8910742f79432372e67ec0627` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:49.673847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4e34f8910742f79432372e67ec0627)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:49.675950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:49.725914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:49.760519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4e34f8910742f79432372e67ec0627', 'request_id': 'req-4565a96f-d963-488a-a1dd-20eefebcbf09'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.771508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4e34f8910742f79432372e67ec0627', 'request_id': 'req-4565a96f-d963-488a-a1dd-20eefebcbf09'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.785892 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4e34f8910742f79432372e67ec0627', 'request_id': 'req-4565a96f-d963-488a-a1dd-20eefebcbf09'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.802899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] The token cache is being invalidate because project 8a4e34f8910742f79432372e67ec0627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:49.803198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.805850 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:49.812283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 858/1748] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:49 2022] DELETE /identity/v3/projects/8a4e34f8910742f79432372e67ec0627 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:49.812800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1abdf5-b5a8-4b10-9504-d14c61d3335c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:49.813402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1abdf5-b5a8-4b10-9504-d14c61d3335c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:49.813402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1abdf5-b5a8-4b10-9504-d14c61d3335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:49.852170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3a1abdf5-b5a8-4b10-9504-d14c61d3335c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:49.853706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3a1abdf5-b5a8-4b10-9504-d14c61d3335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:49.895566 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:49.958312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 891/1749] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:49.972845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:49.977288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88897e96-636f-478f-a624-a747ff0d5e1a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:49.977500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88897e96-636f-478f-a624-a747ff0d5e1a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:49.977785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88897e96-636f-478f-a624-a747ff0d5e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:49.983783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.014505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a96f-d963-488a-a1dd-20eefebcbf09 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.022925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.024319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.024755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.025198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] PATH_INFO: `/v3/projects/0a860b380c5441988c30f68e763fd49b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.026976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a860b380c5441988c30f68e763fd49b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.028891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-88897e96-636f-478f-a624-a747ff0d5e1a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:50.029366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.030195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-88897e96-636f-478f-a624-a747ff0d5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.040193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 892/1750] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:50.045586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88897e96-636f-478f-a624-a747ff0d5e1a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.070134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88897e96-636f-478f-a624-a747ff0d5e1a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.076502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f4077-4893-45a4-8bbd-b5d0b4dddd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.077164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f4077-4893-45a4-8bbd-b5d0b4dddd4c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.077439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f4077-4893-45a4-8bbd-b5d0b4dddd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.077711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f4077-4893-45a4-8bbd-b5d0b4dddd4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.078444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f4077-4893-45a4-8bbd-b5d0b4dddd4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:50.078796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f4077-4893-45a4-8bbd-b5d0b4dddd4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.080713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f4077-4893-45a4-8bbd-b5d0b4dddd4c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.107503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 893/1751] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:50.114508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f4077-4893-45a4-8bbd-b5d0b4dddd4c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.134755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f4077-4893-45a4-8bbd-b5d0b4dddd4c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.136911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a860b380c5441988c30f68e763fd49b', 'request_id': 'req-21ddcc56-6f50-4507-b104-6b18b40849da'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.150473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a860b380c5441988c30f68e763fd49b', 'request_id': 'req-21ddcc56-6f50-4507-b104-6b18b40849da'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.159698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a860b380c5441988c30f68e763fd49b', 'request_id': 'req-21ddcc56-6f50-4507-b104-6b18b40849da'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.183568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] The token cache is being invalidate because project 0a860b380c5441988c30f68e763fd49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:50.184850 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.185735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21ddcc56-6f50-4507-b104-6b18b40849da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.187620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 859/1752] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:49 2022] DELETE /identity/v3/projects/0a860b380c5441988c30f68e763fd49b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:50.194081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fc852-066b-484f-9e13-65eb94aa0624 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.194499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fc852-066b-484f-9e13-65eb94aa0624 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.195225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fc852-066b-484f-9e13-65eb94aa0624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.237018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-170fc852-066b-484f-9e13-65eb94aa0624 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:50.246700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-170fc852-066b-484f-9e13-65eb94aa0624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.266793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741b8e9-19aa-449e-abd3-ad35ac0185b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.267549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b8e9-19aa-449e-abd3-ad35ac0185b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.268784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b8e9-19aa-449e-abd3-ad35ac0185b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.270141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b8e9-19aa-449e-abd3-ad35ac0185b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.271933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741b8e9-19aa-449e-abd3-ad35ac0185b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.273968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741b8e9-19aa-449e-abd3-ad35ac0185b4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.340663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 894/1753] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:50 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:50.345528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741b8e9-19aa-449e-abd3-ad35ac0185b4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.348185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4741b8e9-19aa-449e-abd3-ad35ac0185b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.348532 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 860/1754] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:50.350638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bdc5a-e302-4b1d-a118-3984ccec4950 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.350638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bdc5a-e302-4b1d-a118-3984ccec4950 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.350638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bdc5a-e302-4b1d-a118-3984ccec4950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.377491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e91bdc5a-e302-4b1d-a118-3984ccec4950 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:50.379294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e91bdc5a-e302-4b1d-a118-3984ccec4950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.434322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:50.468246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741b8e9-19aa-449e-abd3-ad35ac0185b4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.488034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b6bb2-5072-4e93-b1f4-6b3b6406665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.488697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6bb2-5072-4e93-b1f4-6b3b6406665e admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.488991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6bb2-5072-4e93-b1f4-6b3b6406665e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.489974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6bb2-5072-4e93-b1f4-6b3b6406665e admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.490641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b6bb2-5072-4e93-b1f4-6b3b6406665e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.492617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b6bb2-5072-4e93-b1f4-6b3b6406665e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.504886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 861/1755] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:50.506950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bdc5a-e302-4b1d-a118-3984ccec4950 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.509596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e91bdc5a-e302-4b1d-a118-3984ccec4950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.535249 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 895/1756] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:50 2022] POST /identity/v3/users => generated 281 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:50.535249 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b6bb2-5072-4e93-b1f4-6b3b6406665e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.544233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bdc5a-e302-4b1d-a118-3984ccec4950 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.547953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b6bb2-5072-4e93-b1f4-6b3b6406665e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.550211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.551753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.552043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.552314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] PATH_INFO: `/v3/users/d2f59ba856594984b35b9e86bf6a4f97` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.553625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f59ba856594984b35b9e86bf6a4f97)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.555373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e360983-9b2e-487b-a910-3f599e6b60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.556164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e360983-9b2e-487b-a910-3f599e6b60f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.556448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e360983-9b2e-487b-a910-3f599e6b60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.556912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e360983-9b2e-487b-a910-3f599e6b60f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.557073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.557699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e360983-9b2e-487b-a910-3f599e6b60f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:50.558086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e360983-9b2e-487b-a910-3f599e6b60f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.560337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e360983-9b2e-487b-a910-3f599e6b60f9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.587705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 896/1757] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:50.588773 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e360983-9b2e-487b-a910-3f599e6b60f9 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.610822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e360983-9b2e-487b-a910-3f599e6b60f9 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.616312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ccefb-6db3-49a6-9f60-680611e42e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.616978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ccefb-6db3-49a6-9f60-680611e42e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.617897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ccefb-6db3-49a6-9f60-680611e42e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.618426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ccefb-6db3-49a6-9f60-680611e42e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.619680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ccefb-6db3-49a6-9f60-680611e42e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.621628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ccefb-6db3-49a6-9f60-680611e42e6d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.642521 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 897/1758] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:50.643966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ccefb-6db3-49a6-9f60-680611e42e6d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.650970 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:50.655629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ccefb-6db3-49a6-9f60-680611e42e6d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.662177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f59ba856594984b35b9e86bf6a4f97'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.667060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badefb6d-f3bb-4945-8578-50a8b6dc6966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.667699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badefb6d-f3bb-4945-8578-50a8b6dc6966 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.667978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badefb6d-f3bb-4945-8578-50a8b6dc6966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.668251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badefb6d-f3bb-4945-8578-50a8b6dc6966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.668963 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badefb6d-f3bb-4945-8578-50a8b6dc6966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.671198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f59ba856594984b35b9e86bf6a4f97'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.671902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badefb6d-f3bb-4945-8578-50a8b6dc6966 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.684724 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f59ba856594984b35b9e86bf6a4f97'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.706345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f59ba856594984b35b9e86bf6a4f97'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.708140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f59ba856594984b35b9e86bf6a4f97'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:50.719062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 898/1759] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:50 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:50.719062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badefb6d-f3bb-4945-8578-50a8b6dc6966 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.721233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-badefb6d-f3bb-4945-8578-50a8b6dc6966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.721857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 862/1760] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:50 2022] DELETE /identity/v3/users/d2f59ba856594984b35b9e86bf6a4f97 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:50.722982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.724429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.790187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badefb6d-f3bb-4945-8578-50a8b6dc6966 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.793819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaae27a-3402-4e07-8df6-32751186169f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.795023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0ac44-8166-42ce-a404-58917050ab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.795648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0ac44-8166-42ce-a404-58917050ab0b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.795926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0ac44-8166-42ce-a404-58917050ab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.796195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0ac44-8166-42ce-a404-58917050ab0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.796871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0ac44-8166-42ce-a404-58917050ab0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.798452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0ac44-8166-42ce-a404-58917050ab0b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.799121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486d38a-35c5-4641-b018-d8ece2fcf230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.799863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486d38a-35c5-4641-b018-d8ece2fcf230 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.800244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486d38a-35c5-4641-b018-d8ece2fcf230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.800619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486d38a-35c5-4641-b018-d8ece2fcf230 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.801366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486d38a-35c5-4641-b018-d8ece2fcf230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.803393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486d38a-35c5-4641-b018-d8ece2fcf230 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.809840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 899/1761] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:50.811072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816c928-dd28-4abb-b20a-03a6180332af None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.816175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816c928-dd28-4abb-b20a-03a6180332af None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.816854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816c928-dd28-4abb-b20a-03a6180332af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.829890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 863/1762] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:50 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:50.830749 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486d38a-35c5-4641-b018-d8ece2fcf230 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.840700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8816c928-dd28-4abb-b20a-03a6180332af None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:50.842106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8816c928-dd28-4abb-b20a-03a6180332af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.852267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486d38a-35c5-4641-b018-d8ece2fcf230 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.853307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 900/1763] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:50.853938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816c928-dd28-4abb-b20a-03a6180332af None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.859693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e1d7-146e-4849-8bd9-febc6561dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.860384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e1d7-146e-4849-8bd9-febc6561dfc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.860668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e1d7-146e-4849-8bd9-febc6561dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.861027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e1d7-146e-4849-8bd9-febc6561dfc2 admin admin] PATH_INFO: `/v3/projects/31e808d61ab141a4b977483e6d4e5382/users/ffd0bc078dc34fe092d056a794f7dcef/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.864164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816c928-dd28-4abb-b20a-03a6180332af None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.870160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76edfb-6446-430f-b6af-0608d210ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.870883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76edfb-6446-430f-b6af-0608d210ef67 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.871159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76edfb-6446-430f-b6af-0608d210ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.871906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76edfb-6446-430f-b6af-0608d210ef67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.872798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76edfb-6446-430f-b6af-0608d210ef67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.874448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76edfb-6446-430f-b6af-0608d210ef67 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.883119 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25e1d7-146e-4849-8bd9-febc6561dfc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e808d61ab141a4b977483e6d4e5382, user_id=ffd0bc078dc34fe092d056a794f7dcef, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.885931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25e1d7-146e-4849-8bd9-febc6561dfc2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:50.889547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 901/1764] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:50.889547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76edfb-6446-430f-b6af-0608d210ef67 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.889547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ba76edfb-6446-430f-b6af-0608d210ef67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.901736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 864/1765] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:50 2022] PUT /identity/v3/projects/31e808d61ab141a4b977483e6d4e5382/users/ffd0bc078dc34fe092d056a794f7dcef/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:50.903567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e1d7-146e-4849-8bd9-febc6561dfc2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.921787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:50.960106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76edfb-6446-430f-b6af-0608d210ef67 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.976244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e1d7-146e-4849-8bd9-febc6561dfc2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:50.982428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d252a9-f02f-4dd2-9d7b-e226f6c08cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:50.983368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d252a9-f02f-4dd2-9d7b-e226f6c08cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.983642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d252a9-f02f-4dd2-9d7b-e226f6c08cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.984164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d252a9-f02f-4dd2-9d7b-e226f6c08cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.985048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d252a9-f02f-4dd2-9d7b-e226f6c08cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:50.990001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d252a9-f02f-4dd2-9d7b-e226f6c08cf0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.002937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 865/1766] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:51.002937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275520f-7a82-4a51-b6f3-1b1a0beb351c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.002937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275520f-7a82-4a51-b6f3-1b1a0beb351c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.002937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275520f-7a82-4a51-b6f3-1b1a0beb351c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.021304 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18453bc0-c796-464c-adaa-7dab4ab6fa46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.022034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18453bc0-c796-464c-adaa-7dab4ab6fa46 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.022317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18453bc0-c796-464c-adaa-7dab4ab6fa46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.022588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18453bc0-c796-464c-adaa-7dab4ab6fa46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.032381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18453bc0-c796-464c-adaa-7dab4ab6fa46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.033835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18453bc0-c796-464c-adaa-7dab4ab6fa46 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.038923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b275520f-7a82-4a51-b6f3-1b1a0beb351c None None] MFA Rules not processed for user `ffd0bc078dc34fe092d056a794f7dcef`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:51.040400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b275520f-7a82-4a51-b6f3-1b1a0beb351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.045317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 902/1767] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:51.054435 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18453bc0-c796-464c-adaa-7dab4ab6fa46 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.067720 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18453bc0-c796-464c-adaa-7dab4ab6fa46 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.072732 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9343e52-0a97-4d2d-b1fa-0e16bd5c41cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.073529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9343e52-0a97-4d2d-b1fa-0e16bd5c41cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.073808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9343e52-0a97-4d2d-b1fa-0e16bd5c41cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.074082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9343e52-0a97-4d2d-b1fa-0e16bd5c41cf admin admin] PATH_INFO: `/v3/projects/4cc8c00ac89f46a7b4d1b4bef200600a/users/286a1f5b29374410985404512c39f8b8/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.093373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9343e52-0a97-4d2d-b1fa-0e16bd5c41cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc8c00ac89f46a7b4d1b4bef200600a, user_id=286a1f5b29374410985404512c39f8b8, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.096139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9343e52-0a97-4d2d-b1fa-0e16bd5c41cf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.103243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:51.124844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 903/1768] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:51 2022] PUT /identity/v3/projects/4cc8c00ac89f46a7b4d1b4bef200600a/users/286a1f5b29374410985404512c39f8b8/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:51.135952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919d66f-3b06-46b4-88c9-f1220e89180f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.136217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919d66f-3b06-46b4-88c9-f1220e89180f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.136536 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919d66f-3b06-46b4-88c9-f1220e89180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.178061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7919d66f-3b06-46b4-88c9-f1220e89180f None None] MFA Rules not processed for user `286a1f5b29374410985404512c39f8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:51.179540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7919d66f-3b06-46b4-88c9-f1220e89180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.200988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 866/1769] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:51.256146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275520f-7a82-4a51-b6f3-1b1a0beb351c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.257376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b275520f-7a82-4a51-b6f3-1b1a0beb351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.349808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275520f-7a82-4a51-b6f3-1b1a0beb351c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.357585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 904/1770] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:51.358600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919d66f-3b06-46b4-88c9-f1220e89180f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.420649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192ebd1-d391-45fa-8d18-a5f130bcad10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.421287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192ebd1-d391-45fa-8d18-a5f130bcad10 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.421555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192ebd1-d391-45fa-8d18-a5f130bcad10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.421891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192ebd1-d391-45fa-8d18-a5f130bcad10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.431551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:51.443700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919d66f-3b06-46b4-88c9-f1220e89180f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.448472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac2f49-331c-48ba-9254-0ddc4f74fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.449106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2f49-331c-48ba-9254-0ddc4f74fc8b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.449387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2f49-331c-48ba-9254-0ddc4f74fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.449665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2f49-331c-48ba-9254-0ddc4f74fc8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.450334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac2f49-331c-48ba-9254-0ddc4f74fc8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.452261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac2f49-331c-48ba-9254-0ddc4f74fc8b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.485520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 905/1771] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:51 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:51.489971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192ebd1-d391-45fa-8d18-a5f130bcad10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.490107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac2f49-331c-48ba-9254-0ddc4f74fc8b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.491616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192ebd1-d391-45fa-8d18-a5f130bcad10 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.506643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 867/1772] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:51.507402 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192ebd1-d391-45fa-8d18-a5f130bcad10 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.509232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b192ebd1-d391-45fa-8d18-a5f130bcad10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.524038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192ebd1-d391-45fa-8d18-a5f130bcad10 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.574515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac2f49-331c-48ba-9254-0ddc4f74fc8b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.579322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58fcdc-a255-466e-9925-986febaaab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.580024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58fcdc-a255-466e-9925-986febaaab4a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.580238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58fcdc-a255-466e-9925-986febaaab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.580506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58fcdc-a255-466e-9925-986febaaab4a admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.581145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58fcdc-a255-466e-9925-986febaaab4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.583081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58fcdc-a255-466e-9925-986febaaab4a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.593686 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.594452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.594767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.595088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] PATH_INFO: `/v3/projects/f5707f1775a7469586519cd83fba8ee8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.596445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5707f1775a7469586519cd83fba8ee8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.598558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.603544 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:51.610162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 906/1773] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:51 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:51.611468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58fcdc-a255-466e-9925-986febaaab4a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.621776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58fcdc-a255-466e-9925-986febaaab4a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.627165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.627851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.628159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.628493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] PATH_INFO: `/v3/users/ffd0bc078dc34fe092d056a794f7dcef` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.629872 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd0bc078dc34fe092d056a794f7dcef)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.631986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.650446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5707f1775a7469586519cd83fba8ee8', 'request_id': 'req-b6cd541d-7b05-4c17-92e2-09a97932224e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.658934 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5707f1775a7469586519cd83fba8ee8', 'request_id': 'req-b6cd541d-7b05-4c17-92e2-09a97932224e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.665597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5707f1775a7469586519cd83fba8ee8', 'request_id': 'req-b6cd541d-7b05-4c17-92e2-09a97932224e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.677411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] The token cache is being invalidate because project f5707f1775a7469586519cd83fba8ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:51.677729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.678433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.679991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 868/1774] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:51 2022] DELETE /identity/v3/projects/f5707f1775a7469586519cd83fba8ee8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:51.680808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.682149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.688292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd0bc078dc34fe092d056a794f7dcef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.697145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd0bc078dc34fe092d056a794f7dcef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.704203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd0bc078dc34fe092d056a794f7dcef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.705108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd0bc078dc34fe092d056a794f7dcef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.717231 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd0bc078dc34fe092d056a794f7dcef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.723337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 907/1775] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:51 2022] DELETE /identity/v3/users/ffd0bc078dc34fe092d056a794f7dcef => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:51.724149 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.725482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.726163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:51.750091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd541d-7b05-4c17-92e2-09a97932224e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.801828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f2035-c69a-492b-9adb-1f78cd7ecfbf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.807658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.808597 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.809018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.809426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] PATH_INFO: `/v3/users/4989d106f89a4a7aa1b4fab2303c1972` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.810757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4989d106f89a4a7aa1b4fab2303c1972)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.810887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671d228-6c6c-4bfb-b291-80f94eed9f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.811522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671d228-6c6c-4bfb-b291-80f94eed9f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.811863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671d228-6c6c-4bfb-b291-80f94eed9f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.812140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671d228-6c6c-4bfb-b291-80f94eed9f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.813096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671d228-6c6c-4bfb-b291-80f94eed9f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.813478 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.815104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671d228-6c6c-4bfb-b291-80f94eed9f91 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.828314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 869/1776] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:51.829432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce090472-0d2c-43e0-979b-052a02663a79 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.829706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce090472-0d2c-43e0-979b-052a02663a79 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.830083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce090472-0d2c-43e0-979b-052a02663a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.852887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ce090472-0d2c-43e0-979b-052a02663a79 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:51.854140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ce090472-0d2c-43e0-979b-052a02663a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.862691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 870/1777] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:51.863565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce090472-0d2c-43e0-979b-052a02663a79 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.864795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ce090472-0d2c-43e0-979b-052a02663a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.877808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce090472-0d2c-43e0-979b-052a02663a79 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.882872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396801c-164f-444b-acbb-025bc6215774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.884003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396801c-164f-444b-acbb-025bc6215774 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.884320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396801c-164f-444b-acbb-025bc6215774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.884600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396801c-164f-444b-acbb-025bc6215774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.885348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396801c-164f-444b-acbb-025bc6215774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.889567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396801c-164f-444b-acbb-025bc6215774 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.889730 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4989d106f89a4a7aa1b4fab2303c1972'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.897313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4989d106f89a4a7aa1b4fab2303c1972'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.898274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 871/1778] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:51.899149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396801c-164f-444b-acbb-025bc6215774 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.900975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c396801c-164f-444b-acbb-025bc6215774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.905193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4989d106f89a4a7aa1b4fab2303c1972'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.906023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4989d106f89a4a7aa1b4fab2303c1972'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.914548 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:51.920332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4989d106f89a4a7aa1b4fab2303c1972'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:51.931147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 908/1779] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:51 2022] DELETE /identity/v3/users/4989d106f89a4a7aa1b4fab2303c1972 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:51.935451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.936925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.972833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396801c-164f-444b-acbb-025bc6215774 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:52.051195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d390d9-5f77-4716-8a5a-7b94e38dce07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:52.051857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d390d9-5f77-4716-8a5a-7b94e38dce07 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.052158 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d390d9-5f77-4716-8a5a-7b94e38dce07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.052519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d390d9-5f77-4716-8a5a-7b94e38dce07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.059379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-76d390d9-5f77-4716-8a5a-7b94e38dce07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.068000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a857b9-b643-4857-8edd-156192ff2fe2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:52.073916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d390d9-5f77-4716-8a5a-7b94e38dce07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:52.075499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d390d9-5f77-4716-8a5a-7b94e38dce07 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:52.075939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2ff98-a2ad-4121-a6f9-5ab4af8b46d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:52.077071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2ff98-a2ad-4121-a6f9-5ab4af8b46d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.077071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2ff98-a2ad-4121-a6f9-5ab4af8b46d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.077298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2ff98-a2ad-4121-a6f9-5ab4af8b46d5 admin admin] PATH_INFO: `/v3/projects/b75ecee0896a4283bdfd130663d9a930/users/9986e51e12dc4ad3b1f355b5d67b711f/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.088068 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 872/1780] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:52.095126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2ff98-a2ad-4121-a6f9-5ab4af8b46d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75ecee0896a4283bdfd130663d9a930, user_id=9986e51e12dc4ad3b1f355b5d67b711f, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:52.097812 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2ff98-a2ad-4121-a6f9-5ab4af8b46d5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:52.121522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 909/1781] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:51 2022] PUT /identity/v3/projects/b75ecee0896a4283bdfd130663d9a930/users/9986e51e12dc4ad3b1f355b5d67b711f/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:52.133413 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae8ba4-4c5c-499e-8895-d0ab4fda09fc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.133704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae8ba4-4c5c-499e-8895-d0ab4fda09fc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.133979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae8ba4-4c5c-499e-8895-d0ab4fda09fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.168625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fbae8ba4-4c5c-499e-8895-d0ab4fda09fc None None] MFA Rules not processed for user `9986e51e12dc4ad3b1f355b5d67b711f`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:52.170107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fbae8ba4-4c5c-499e-8895-d0ab4fda09fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.189753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:52.279660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2ff98-a2ad-4121-a6f9-5ab4af8b46d5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:52.282018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c1f2ff98-a2ad-4121-a6f9-5ab4af8b46d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.312876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 873/1782] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:52.328431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae8ba4-4c5c-499e-8895-d0ab4fda09fc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:52.403020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2ff98-a2ad-4121-a6f9-5ab4af8b46d5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:52.409415 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:52.410076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.410359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.410636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] PATH_INFO: `/v3/projects/59974172a2f349c8acff8a3063ef0edb` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.411873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59974172a2f349c8acff8a3063ef0edb)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:52.413959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:52.497879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae8ba4-4c5c-499e-8895-d0ab4fda09fc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:52.513700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59974172a2f349c8acff8a3063ef0edb', 'request_id': 'req-bc53052f-0a14-4abd-b126-d2f982edc011'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.530365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59974172a2f349c8acff8a3063ef0edb', 'request_id': 'req-bc53052f-0a14-4abd-b126-d2f982edc011'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.549710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59974172a2f349c8acff8a3063ef0edb', 'request_id': 'req-bc53052f-0a14-4abd-b126-d2f982edc011'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.577217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] The token cache is being invalidate because project 59974172a2f349c8acff8a3063ef0edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:52.577546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.578388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.581679 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 910/1783] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:52 2022] DELETE /identity/v3/projects/59974172a2f349c8acff8a3063ef0edb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:52.600315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:52.602772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.611305 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:52.613886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b75a0f-cb50-494a-8707-9063f8dc1ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:52.614541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b75a0f-cb50-494a-8707-9063f8dc1ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.614854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b75a0f-cb50-494a-8707-9063f8dc1ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.615127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b75a0f-cb50-494a-8707-9063f8dc1ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.615787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b75a0f-cb50-494a-8707-9063f8dc1ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:52.617770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b75a0f-cb50-494a-8707-9063f8dc1ec8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:52.653099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 874/1784] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:52 2022] POST /identity/v3/projects => generated 383 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:52.653099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5cd40-dccb-4edd-a38e-28fa0f141748 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.653099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5cd40-dccb-4edd-a38e-28fa0f141748 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.653099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5cd40-dccb-4edd-a38e-28fa0f141748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.674629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1ed5cd40-dccb-4edd-a38e-28fa0f141748 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:52.675893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1ed5cd40-dccb-4edd-a38e-28fa0f141748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.729549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53052f-0a14-4abd-b126-d2f982edc011 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:52.736808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:52.761073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 875/1785] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:52.761915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5cd40-dccb-4edd-a38e-28fa0f141748 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:52.772182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1ed5cd40-dccb-4edd-a38e-28fa0f141748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.789341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5cd40-dccb-4edd-a38e-28fa0f141748 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:52.795198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719970-e674-4bbe-9c0e-80eba12d170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:52.795912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719970-e674-4bbe-9c0e-80eba12d170c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.796333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719970-e674-4bbe-9c0e-80eba12d170c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.796739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719970-e674-4bbe-9c0e-80eba12d170c admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.797506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719970-e674-4bbe-9c0e-80eba12d170c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:52.799637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719970-e674-4bbe-9c0e-80eba12d170c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:52.805873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:52.806561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.806882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.807162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] PATH_INFO: `/v3/projects/31e808d61ab141a4b977483e6d4e5382` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.808296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e808d61ab141a4b977483e6d4e5382)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:52.810398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:52.828887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 876/1786] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:52 2022] POST /identity/v3/users => generated 298 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:52.828887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868815d-c856-4212-ba19-fb57a75b47a7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.828887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868815d-c856-4212-ba19-fb57a75b47a7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.828887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868815d-c856-4212-ba19-fb57a75b47a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.852821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5868815d-c856-4212-ba19-fb57a75b47a7 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:52.854175 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5868815d-c856-4212-ba19-fb57a75b47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.864585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 877/1787] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:52.865497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868815d-c856-4212-ba19-fb57a75b47a7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:52.878219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868815d-c856-4212-ba19-fb57a75b47a7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:52.880876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e808d61ab141a4b977483e6d4e5382', 'request_id': 'req-df3fd611-16ab-4def-b322-ff136e372b44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.888627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e808d61ab141a4b977483e6d4e5382', 'request_id': 'req-df3fd611-16ab-4def-b322-ff136e372b44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.895892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e808d61ab141a4b977483e6d4e5382', 'request_id': 'req-df3fd611-16ab-4def-b322-ff136e372b44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.913097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] The token cache is being invalidate because project 31e808d61ab141a4b977483e6d4e5382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:52.913491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.915111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:52.917110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 911/1788] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:52 2022] DELETE /identity/v3/projects/31e808d61ab141a4b977483e6d4e5382 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:52.917953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:52.919487 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.951074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f57050-0d4d-4620-ba68-1f6f4831f185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:52.951857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57050-0d4d-4620-ba68-1f6f4831f185 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.952340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57050-0d4d-4620-ba68-1f6f4831f185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.952835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57050-0d4d-4620-ba68-1f6f4831f185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.953621 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f57050-0d4d-4620-ba68-1f6f4831f185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:52.955459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f57050-0d4d-4620-ba68-1f6f4831f185 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:52.967272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 878/1789] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:52.968870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a464a-c5a8-481d-8e21-ca9e5fac9182 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.969158 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a464a-c5a8-481d-8e21-ca9e5fac9182 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.969439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a464a-c5a8-481d-8e21-ca9e5fac9182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.979842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:52.990255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9c7a464a-c5a8-481d-8e21-ca9e5fac9182 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:52.991535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c7a464a-c5a8-481d-8e21-ca9e5fac9182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:53.000265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 879/1790] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:53.000734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fd611-16ab-4def-b322-ff136e372b44 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.000849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a464a-c5a8-481d-8e21-ca9e5fac9182 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.002012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c7a464a-c5a8-481d-8e21-ca9e5fac9182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:53.010375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01ec46-ab4a-4d42-9f97-9ab7f1af7d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.011043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01ec46-ab4a-4d42-9f97-9ab7f1af7d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.011329 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01ec46-ab4a-4d42-9f97-9ab7f1af7d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.011603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01ec46-ab4a-4d42-9f97-9ab7f1af7d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.012264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01ec46-ab4a-4d42-9f97-9ab7f1af7d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:53.012570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01ec46-ab4a-4d42-9f97-9ab7f1af7d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.013483 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a464a-c5a8-481d-8e21-ca9e5fac9182 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.014209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01ec46-ab4a-4d42-9f97-9ab7f1af7d13 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.019004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d779-69de-41e8-83c5-18cfcf9b7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.019671 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d779-69de-41e8-83c5-18cfcf9b7b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.019978 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d779-69de-41e8-83c5-18cfcf9b7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.020250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d779-69de-41e8-83c5-18cfcf9b7b61 admin admin] PATH_INFO: `/v3/projects/d1091f49ff14482e934e6142e532c563/users/ae58f79c4e0040c7a1a13004269e6375/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.026435 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 912/1791] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:53.027763 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b57b5-3ab7-4277-8bea-2b9dd7411520 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.028049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b57b5-3ab7-4277-8bea-2b9dd7411520 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.028327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b57b5-3ab7-4277-8bea-2b9dd7411520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.037367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502d779-69de-41e8-83c5-18cfcf9b7b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1091f49ff14482e934e6142e532c563, user_id=ae58f79c4e0040c7a1a13004269e6375, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.039299 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502d779-69de-41e8-83c5-18cfcf9b7b61 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.049763 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9e5b57b5-3ab7-4277-8bea-2b9dd7411520 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:53.051124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9e5b57b5-3ab7-4277-8bea-2b9dd7411520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:53.053235 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 880/1792] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:53 2022] PUT /identity/v3/projects/d1091f49ff14482e934e6142e532c563/users/ae58f79c4e0040c7a1a13004269e6375/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:53.054025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d779-69de-41e8-83c5-18cfcf9b7b61 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.128472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 913/1793] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:53.128472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b57b5-3ab7-4277-8bea-2b9dd7411520 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.128768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d779-69de-41e8-83c5-18cfcf9b7b61 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.132372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e15e7-9a36-4c1f-9e9d-0643c7fd76e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.133000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e15e7-9a36-4c1f-9e9d-0643c7fd76e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.133286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e15e7-9a36-4c1f-9e9d-0643c7fd76e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.133648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e15e7-9a36-4c1f-9e9d-0643c7fd76e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.134314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e15e7-9a36-4c1f-9e9d-0643c7fd76e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.135424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b57b5-3ab7-4277-8bea-2b9dd7411520 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.136411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e15e7-9a36-4c1f-9e9d-0643c7fd76e1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.140936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae8bb5-d3f6-45d8-88bf-133bef16d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.141883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae8bb5-d3f6-45d8-88bf-133bef16d891 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.142164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae8bb5-d3f6-45d8-88bf-133bef16d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.142439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae8bb5-d3f6-45d8-88bf-133bef16d891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.143189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae8bb5-d3f6-45d8-88bf-133bef16d891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.144733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae8bb5-d3f6-45d8-88bf-133bef16d891 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.155900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 914/1794] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:53.157159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae8bb5-d3f6-45d8-88bf-133bef16d891 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.166263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 881/1795] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:53.167296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e15e7-9a36-4c1f-9e9d-0643c7fd76e1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.167729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae8bb5-d3f6-45d8-88bf-133bef16d891 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.180169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:53.229250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f28a92-c6a1-4cdb-be86-bb9153b88e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.230056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f28a92-c6a1-4cdb-be86-bb9153b88e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.230389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f28a92-c6a1-4cdb-be86-bb9153b88e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.230655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f28a92-c6a1-4cdb-be86-bb9153b88e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.231376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f28a92-c6a1-4cdb-be86-bb9153b88e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:53.232207 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f28a92-c6a1-4cdb-be86-bb9153b88e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.233362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f28a92-c6a1-4cdb-be86-bb9153b88e77 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.236256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e15e7-9a36-4c1f-9e9d-0643c7fd76e1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.241928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26011-08b4-4f2b-90ac-875636317125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.242606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26011-08b4-4f2b-90ac-875636317125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.242917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26011-08b4-4f2b-90ac-875636317125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.243314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26011-08b4-4f2b-90ac-875636317125 admin admin] PATH_INFO: `/v3/projects/d1091f49ff14482e934e6142e532c563/users/ae58f79c4e0040c7a1a13004269e6375/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.245235 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb26011-08b4-4f2b-90ac-875636317125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1091f49ff14482e934e6142e532c563, user_id=ae58f79c4e0040c7a1a13004269e6375, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.245982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 915/1796] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:53.246800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f28a92-c6a1-4cdb-be86-bb9153b88e77 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.247982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb26011-08b4-4f2b-90ac-875636317125 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.256921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f28a92-c6a1-4cdb-be86-bb9153b88e77 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.259932 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 882/1797] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:53 2022] PUT /identity/v3/projects/d1091f49ff14482e934e6142e532c563/users/ae58f79c4e0040c7a1a13004269e6375/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:53.268006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26011-08b4-4f2b-90ac-875636317125 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.322973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae72d4c-7d87-403b-984e-528a87b69388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.323602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae72d4c-7d87-403b-984e-528a87b69388 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.323883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae72d4c-7d87-403b-984e-528a87b69388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.324160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae72d4c-7d87-403b-984e-528a87b69388 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.324794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae72d4c-7d87-403b-984e-528a87b69388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.326704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae72d4c-7d87-403b-984e-528a87b69388 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.329618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26011-08b4-4f2b-90ac-875636317125 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.335562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:53.337545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948ddbd-d6d9-48ad-9f44-56c1b82f67fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.338211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948ddbd-d6d9-48ad-9f44-56c1b82f67fa admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.338469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948ddbd-d6d9-48ad-9f44-56c1b82f67fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.338783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948ddbd-d6d9-48ad-9f44-56c1b82f67fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.339541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948ddbd-d6d9-48ad-9f44-56c1b82f67fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.341649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948ddbd-d6d9-48ad-9f44-56c1b82f67fa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.360497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 916/1798] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:53.361918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc437f-f79b-4c8a-9d18-401d51a888c5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.362266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc437f-f79b-4c8a-9d18-401d51a888c5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.362565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc437f-f79b-4c8a-9d18-401d51a888c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.380147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 883/1799] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:53.381084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948ddbd-d6d9-48ad-9f44-56c1b82f67fa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.395799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d2cc437f-f79b-4c8a-9d18-401d51a888c5 None None] MFA Rules not processed for user `ae58f79c4e0040c7a1a13004269e6375`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:53.397013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d2cc437f-f79b-4c8a-9d18-401d51a888c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:53.464591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948ddbd-d6d9-48ad-9f44-56c1b82f67fa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.470490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd006c-ca75-40fb-be75-15a2ec1385a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.471256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd006c-ca75-40fb-be75-15a2ec1385a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.471808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd006c-ca75-40fb-be75-15a2ec1385a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.472086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd006c-ca75-40fb-be75-15a2ec1385a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.472738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd006c-ca75-40fb-be75-15a2ec1385a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.474319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd006c-ca75-40fb-be75-15a2ec1385a8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.476379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 917/1800] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:53.477303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc437f-f79b-4c8a-9d18-401d51a888c5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.494402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc437f-f79b-4c8a-9d18-401d51a888c5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.495514 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 884/1801] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:53.496673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd006c-ca75-40fb-be75-15a2ec1385a8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.499829 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a1bd006c-ca75-40fb-be75-15a2ec1385a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:53.500603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddc98d-b16a-4714-a218-49a36ba2a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.501342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddc98d-b16a-4714-a218-49a36ba2a07d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.501622 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddc98d-b16a-4714-a218-49a36ba2a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.501893 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddc98d-b16a-4714-a218-49a36ba2a07d admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.502549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddc98d-b16a-4714-a218-49a36ba2a07d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.504489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddc98d-b16a-4714-a218-49a36ba2a07d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.532480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 918/1802] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:53.532480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddc98d-b16a-4714-a218-49a36ba2a07d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.539514 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:53.541371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddc98d-b16a-4714-a218-49a36ba2a07d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.546768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d99dd-d30c-4349-a17b-86617909e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.547419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d99dd-d30c-4349-a17b-86617909e32a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.547703 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d99dd-d30c-4349-a17b-86617909e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.547980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d99dd-d30c-4349-a17b-86617909e32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.548644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d99dd-d30c-4349-a17b-86617909e32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.550259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d99dd-d30c-4349-a17b-86617909e32a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.563581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 919/1803] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:53.564955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d99dd-d30c-4349-a17b-86617909e32a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.578747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d99dd-d30c-4349-a17b-86617909e32a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.581407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd006c-ca75-40fb-be75-15a2ec1385a8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.584085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b4508-8672-49bd-94d6-cf519ae5a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.584739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b4508-8672-49bd-94d6-cf519ae5a699 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.585018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b4508-8672-49bd-94d6-cf519ae5a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.585292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b4508-8672-49bd-94d6-cf519ae5a699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.585959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b4508-8672-49bd-94d6-cf519ae5a699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.587629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b4508-8672-49bd-94d6-cf519ae5a699 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.591497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929d674-f2d7-4b0f-9447-431e39de4229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.592452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929d674-f2d7-4b0f-9447-431e39de4229 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.592912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929d674-f2d7-4b0f-9447-431e39de4229 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.593794 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929d674-f2d7-4b0f-9447-431e39de4229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.595950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6929d674-f2d7-4b0f-9447-431e39de4229 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:53.598310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 920/1804] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:53.599170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b4508-8672-49bd-94d6-cf519ae5a699 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.609646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b4508-8672-49bd-94d6-cf519ae5a699 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.618107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d631a24-2313-42fc-95b1-1adfbaaa99aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.619378 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d631a24-2313-42fc-95b1-1adfbaaa99aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.619658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d631a24-2313-42fc-95b1-1adfbaaa99aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.619929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d631a24-2313-42fc-95b1-1adfbaaa99aa admin admin] PATH_INFO: `/v3/projects/28fc217840b7452fb046312ef6bcd6e7/users/ea765d2dbdec49d4863b597c8096d2b1/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.637892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d631a24-2313-42fc-95b1-1adfbaaa99aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=28fc217840b7452fb046312ef6bcd6e7, user_id=ea765d2dbdec49d4863b597c8096d2b1, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.640635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d631a24-2313-42fc-95b1-1adfbaaa99aa admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.659436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 921/1805] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:53 2022] PUT /identity/v3/projects/28fc217840b7452fb046312ef6bcd6e7/users/ea765d2dbdec49d4863b597c8096d2b1/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:53.668540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d631a24-2313-42fc-95b1-1adfbaaa99aa admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.668747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929d674-f2d7-4b0f-9447-431e39de4229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.668747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929d674-f2d7-4b0f-9447-431e39de4229 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.676950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 885/1806] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:53.678270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a712-846f-408c-b41e-31ce60d647f3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.678589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a712-846f-408c-b41e-31ce60d647f3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.678893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a712-846f-408c-b41e-31ce60d647f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.713960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a547a712-846f-408c-b41e-31ce60d647f3 None None] MFA Rules not processed for user `ea765d2dbdec49d4863b597c8096d2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:53.715278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a547a712-846f-408c-b41e-31ce60d647f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:53.739769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d631a24-2313-42fc-95b1-1adfbaaa99aa admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.745607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e9b33-d2bf-4c4e-a9d3-83ee86abdc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.746233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e9b33-d2bf-4c4e-a9d3-83ee86abdc1c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.746589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e9b33-d2bf-4c4e-a9d3-83ee86abdc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.747029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e9b33-d2bf-4c4e-a9d3-83ee86abdc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.747735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e9b33-d2bf-4c4e-a9d3-83ee86abdc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.749867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e9b33-d2bf-4c4e-a9d3-83ee86abdc1c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.764454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 922/1807] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:53.768666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e9b33-d2bf-4c4e-a9d3-83ee86abdc1c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.783773 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e9b33-d2bf-4c4e-a9d3-83ee86abdc1c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.787456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 886/1808] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:53.791695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a712-846f-408c-b41e-31ce60d647f3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.792175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa20a-b75e-4c86-89e4-9b24917117c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.792970 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa20a-b75e-4c86-89e4-9b24917117c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.793422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa20a-b75e-4c86-89e4-9b24917117c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.793705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa20a-b75e-4c86-89e4-9b24917117c3 admin admin] PATH_INFO: `/v3/projects/07a56804063e431188d3fe9c58b7ee2e/users/a3ac3e0e04254f6d9dbdc4a8bb2e9962/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.796612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:53.803703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a712-846f-408c-b41e-31ce60d647f3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.810480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f91523-dc84-4058-b810-72e1c0c2c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.811335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91523-dc84-4058-b810-72e1c0c2c8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.811771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91523-dc84-4058-b810-72e1c0c2c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.812029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aa20a-b75e-4c86-89e4-9b24917117c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a56804063e431188d3fe9c58b7ee2e, user_id=a3ac3e0e04254f6d9dbdc4a8bb2e9962, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.812527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91523-dc84-4058-b810-72e1c0c2c8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.813460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f91523-dc84-4058-b810-72e1c0c2c8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.815484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aa20a-b75e-4c86-89e4-9b24917117c3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.815810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f91523-dc84-4058-b810-72e1c0c2c8f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.837705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 923/1809] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:53 2022] PUT /identity/v3/projects/07a56804063e431188d3fe9c58b7ee2e/users/a3ac3e0e04254f6d9dbdc4a8bb2e9962/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:53.849930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b762a8-4b01-4b1e-a62b-46a02c9c079d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.850322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b762a8-4b01-4b1e-a62b-46a02c9c079d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.850865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b762a8-4b01-4b1e-a62b-46a02c9c079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.866598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 887/1810] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:53.870646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f91523-dc84-4058-b810-72e1c0c2c8f6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.890989 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-77b762a8-4b01-4b1e-a62b-46a02c9c079d None None] MFA Rules not processed for user `a3ac3e0e04254f6d9dbdc4a8bb2e9962`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:53.892359 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-77b762a8-4b01-4b1e-a62b-46a02c9c079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:53.935027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:53.952829 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f91523-dc84-4058-b810-72e1c0c2c8f6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:53.958691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e67c4c-0d4a-43fc-90e1-31169ee0f6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:53.959547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e67c4c-0d4a-43fc-90e1-31169ee0f6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.960386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e67c4c-0d4a-43fc-90e1-31169ee0f6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.960927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e67c4c-0d4a-43fc-90e1-31169ee0f6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.961872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e67c4c-0d4a-43fc-90e1-31169ee0f6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:53.964610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e67c4c-0d4a-43fc-90e1-31169ee0f6a5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:53.984657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 924/1811] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:53.996744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 888/1812] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:53 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:53.997735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b762a8-4b01-4b1e-a62b-46a02c9c079d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:53.999664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-77b762a8-4b01-4b1e-a62b-46a02c9c079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:54.001244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e67c4c-0d4a-43fc-90e1-31169ee0f6a5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.017689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e67c4c-0d4a-43fc-90e1-31169ee0f6a5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.039506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22d7a-f713-4b13-9c0d-79d230bd603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.040428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22d7a-f713-4b13-9c0d-79d230bd603c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.040855 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22d7a-f713-4b13-9c0d-79d230bd603c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.041273 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22d7a-f713-4b13-9c0d-79d230bd603c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.042161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea22d7a-f713-4b13-9c0d-79d230bd603c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.044192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea22d7a-f713-4b13-9c0d-79d230bd603c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.069553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 889/1813] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:54.071073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22d7a-f713-4b13-9c0d-79d230bd603c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.085298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22d7a-f713-4b13-9c0d-79d230bd603c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.093775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942ac9-cf7f-4bc1-82d8-16c0c9e1d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.094836 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942ac9-cf7f-4bc1-82d8-16c0c9e1d8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.095333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942ac9-cf7f-4bc1-82d8-16c0c9e1d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.095711 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942ac9-cf7f-4bc1-82d8-16c0c9e1d8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.098000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38942ac9-cf7f-4bc1-82d8-16c0c9e1d8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.100911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38942ac9-cf7f-4bc1-82d8-16c0c9e1d8b0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.116283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b762a8-4b01-4b1e-a62b-46a02c9c079d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.119840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 890/1814] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:54.121213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942ac9-cf7f-4bc1-82d8-16c0c9e1d8b0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.122315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6721-8299-4839-92a7-66fdb41a3ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.123401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6721-8299-4839-92a7-66fdb41a3ecc service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.123858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6721-8299-4839-92a7-66fdb41a3ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.124131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6721-8299-4839-92a7-66fdb41a3ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.133608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6721-8299-4839-92a7-66fdb41a3ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.135201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6721-8299-4839-92a7-66fdb41a3ecc service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.139473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942ac9-cf7f-4bc1-82d8-16c0c9e1d8b0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.145717 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d6a8e-e52d-4873-8924-14fb03958fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.146310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 925/1815] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:54.146880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d6a8e-e52d-4873-8924-14fb03958fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.147229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d6a8e-e52d-4873-8924-14fb03958fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.147679 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d6a8e-e52d-4873-8924-14fb03958fbc admin admin] PATH_INFO: `/v3/projects/c5f9fd73a7be4fd6adeca340f87cb6d0/users/426f36a2a2b046e8aa1c6254c51bd8d9/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.166076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d6a8e-e52d-4873-8924-14fb03958fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f9fd73a7be4fd6adeca340f87cb6d0, user_id=426f36a2a2b046e8aa1c6254c51bd8d9, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.169899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d6a8e-e52d-4873-8924-14fb03958fbc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.187225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 891/1816] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:54 2022] PUT /identity/v3/projects/c5f9fd73a7be4fd6adeca340f87cb6d0/users/426f36a2a2b046e8aa1c6254c51bd8d9/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:54.202899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c232c-00bd-46ec-a415-d78ff1473b4a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.203264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c232c-00bd-46ec-a415-d78ff1473b4a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.203641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c232c-00bd-46ec-a415-d78ff1473b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.232891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fc4c232c-00bd-46ec-a415-d78ff1473b4a None None] MFA Rules not processed for user `426f36a2a2b046e8aa1c6254c51bd8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:54.234356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fc4c232c-00bd-46ec-a415-d78ff1473b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:54.311472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 926/1817] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:54.314970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d6a8e-e52d-4873-8924-14fb03958fbc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.384755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d6a8e-e52d-4873-8924-14fb03958fbc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.389891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f044fe-3ed7-433f-a955-5db29c399e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.390514 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f044fe-3ed7-433f-a955-5db29c399e94 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.390874 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f044fe-3ed7-433f-a955-5db29c399e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.391273 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f044fe-3ed7-433f-a955-5db29c399e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.391939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f044fe-3ed7-433f-a955-5db29c399e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.394018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f044fe-3ed7-433f-a955-5db29c399e94 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.425826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 892/1818] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:54 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:54.430038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c232c-00bd-46ec-a415-d78ff1473b4a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.447112 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:54.469327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c232c-00bd-46ec-a415-d78ff1473b4a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.587754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab472239-aed7-46f2-82e6-36494dc4762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.588407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab472239-aed7-46f2-82e6-36494dc4762e admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.588691 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab472239-aed7-46f2-82e6-36494dc4762e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.588947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab472239-aed7-46f2-82e6-36494dc4762e admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.589585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab472239-aed7-46f2-82e6-36494dc4762e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.591725 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab472239-aed7-46f2-82e6-36494dc4762e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.614534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 927/1819] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:54 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:54.618777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f044fe-3ed7-433f-a955-5db29c399e94 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.630042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f044fe-3ed7-433f-a955-5db29c399e94 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.634685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d8ff8-c85a-480e-abbb-764441772662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.635333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d8ff8-c85a-480e-abbb-764441772662 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.635615 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d8ff8-c85a-480e-abbb-764441772662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.635888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d8ff8-c85a-480e-abbb-764441772662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.636566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d8ff8-c85a-480e-abbb-764441772662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.638169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d8ff8-c85a-480e-abbb-764441772662 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.654283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 893/1820] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:54.655671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab472239-aed7-46f2-82e6-36494dc4762e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.667510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab472239-aed7-46f2-82e6-36494dc4762e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.672870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1342f95-e083-4d26-8f69-7deda25ec050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.673706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1342f95-e083-4d26-8f69-7deda25ec050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.673998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1342f95-e083-4d26-8f69-7deda25ec050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.674300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1342f95-e083-4d26-8f69-7deda25ec050 admin admin] PATH_INFO: `/v3/projects/8cf9fde7a7be40518acbab9f2ce762a8/users/c62ed35018404240bb83f4107fa49040/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.691723 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1342f95-e083-4d26-8f69-7deda25ec050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf9fde7a7be40518acbab9f2ce762a8, user_id=c62ed35018404240bb83f4107fa49040, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.694612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1342f95-e083-4d26-8f69-7deda25ec050 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.714140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 928/1821] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:54 2022] PUT /identity/v3/projects/8cf9fde7a7be40518acbab9f2ce762a8/users/c62ed35018404240bb83f4107fa49040/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:54.718375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d8ff8-c85a-480e-abbb-764441772662 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.733523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d8ff8-c85a-480e-abbb-764441772662 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.796830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cb431-fd00-49f3-96ec-5e2dd44a8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.797465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cb431-fd00-49f3-96ec-5e2dd44a8e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.797748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cb431-fd00-49f3-96ec-5e2dd44a8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.798021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cb431-fd00-49f3-96ec-5e2dd44a8e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.798677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cb431-fd00-49f3-96ec-5e2dd44a8e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.800326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cb431-fd00-49f3-96ec-5e2dd44a8e7d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.815042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 894/1822] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:54.816322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1342f95-e083-4d26-8f69-7deda25ec050 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.826799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1342f95-e083-4d26-8f69-7deda25ec050 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.845593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6c2b9-6f0e-4897-9484-f1fd6c2269f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.846452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6c2b9-6f0e-4897-9484-f1fd6c2269f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.846760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6c2b9-6f0e-4897-9484-f1fd6c2269f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.847042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6c2b9-6f0e-4897-9484-f1fd6c2269f1 admin admin] PATH_INFO: `/v3/projects/8cf9fde7a7be40518acbab9f2ce762a8/users/c62ed35018404240bb83f4107fa49040/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.849114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6c2b9-6f0e-4897-9484-f1fd6c2269f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf9fde7a7be40518acbab9f2ce762a8, user_id=c62ed35018404240bb83f4107fa49040, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.852072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6c2b9-6f0e-4897-9484-f1fd6c2269f1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.864353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 929/1823] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:54 2022] PUT /identity/v3/projects/8cf9fde7a7be40518acbab9f2ce762a8/users/c62ed35018404240bb83f4107fa49040/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:54.876170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0bc84-2790-46d2-b9b6-bb1549538485 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.876569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0bc84-2790-46d2-b9b6-bb1549538485 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.876891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0bc84-2790-46d2-b9b6-bb1549538485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.886132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:54.908577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-16c0bc84-2790-46d2-b9b6-bb1549538485 None None] MFA Rules not processed for user `c62ed35018404240bb83f4107fa49040`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:54.909737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-16c0bc84-2790-46d2-b9b6-bb1549538485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:54.982982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 895/1824] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:54.995285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6c2b9-6f0e-4897-9484-f1fd6c2269f1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:55.052826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6c2b9-6f0e-4897-9484-f1fd6c2269f1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:55.056788 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993721-76c6-4236-a682-93a9acd0fed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:55.057454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993721-76c6-4236-a682-93a9acd0fed1 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.057734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993721-76c6-4236-a682-93a9acd0fed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.058003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993721-76c6-4236-a682-93a9acd0fed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.127379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b993721-76c6-4236-a682-93a9acd0fed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:55.128880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b993721-76c6-4236-a682-93a9acd0fed1 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:55.138073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 930/1825] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:55.411440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0bc84-2790-46d2-b9b6-bb1549538485 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:55.436689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0bc84-2790-46d2-b9b6-bb1549538485 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:55.441428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23216-798d-4af6-a1b8-2dfdba50bbf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:55.442061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23216-798d-4af6-a1b8-2dfdba50bbf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.442414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23216-798d-4af6-a1b8-2dfdba50bbf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.442634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23216-798d-4af6-a1b8-2dfdba50bbf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.444807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e6f23216-798d-4af6-a1b8-2dfdba50bbf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:55.555441 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f23216-798d-4af6-a1b8-2dfdba50bbf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:55.557263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f23216-798d-4af6-a1b8-2dfdba50bbf0 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:55.580731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 896/1826] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:24:56.451806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993721-76c6-4236-a682-93a9acd0fed1 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:56.463829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993721-76c6-4236-a682-93a9acd0fed1 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:56.468760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484b2a-cdbc-48c5-b955-9bd9c1f21eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:56.469770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484b2a-cdbc-48c5-b955-9bd9c1f21eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:56.470110 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484b2a-cdbc-48c5-b955-9bd9c1f21eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:56.471004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484b2a-cdbc-48c5-b955-9bd9c1f21eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:56.481009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:56.636025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9484b2a-cdbc-48c5-b955-9bd9c1f21eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:56.638013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9484b2a-cdbc-48c5-b955-9bd9c1f21eb2 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:56.654962 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 931/1827] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:56.942835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23216-798d-4af6-a1b8-2dfdba50bbf0 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:56.957727 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23216-798d-4af6-a1b8-2dfdba50bbf0 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:56.969673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120bfe2-1140-4399-aa9e-ec8fed052e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:56.970810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120bfe2-1140-4399-aa9e-ec8fed052e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:56.971226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120bfe2-1140-4399-aa9e-ec8fed052e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:56.971688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120bfe2-1140-4399-aa9e-ec8fed052e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:57.080037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120bfe2-1140-4399-aa9e-ec8fed052e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:57.082228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120bfe2-1140-4399-aa9e-ec8fed052e5e service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:57.095812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 897/1828] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:57.776673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484b2a-cdbc-48c5-b955-9bd9c1f21eb2 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:57.785302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484b2a-cdbc-48c5-b955-9bd9c1f21eb2 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:57.790109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4807c-03e2-4dc8-ae22-14d51e1a8e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:57.793923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4807c-03e2-4dc8-ae22-14d51e1a8e0f service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:57.793923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4807c-03e2-4dc8-ae22-14d51e1a8e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:57.793923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4807c-03e2-4dc8-ae22-14d51e1a8e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:57.804106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4807c-03e2-4dc8-ae22-14d51e1a8e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:57.805561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4807c-03e2-4dc8-ae22-14d51e1a8e0f service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:57.816689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 932/1829] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:58.636965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120bfe2-1140-4399-aa9e-ec8fed052e5e service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:58.643059 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f120bfe2-1140-4399-aa9e-ec8fed052e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:58.688741 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:58.740249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120bfe2-1140-4399-aa9e-ec8fed052e5e service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:58.745579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:58.746239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:58.746576 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:58.747105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] PATH_INFO: `/v3/users/16050dda2b5e42e2b245dfc5f4a43532` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:58.748824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16050dda2b5e42e2b245dfc5f4a43532)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:58.750837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:58.800498 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16050dda2b5e42e2b245dfc5f4a43532'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:58.807860 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16050dda2b5e42e2b245dfc5f4a43532'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:58.820311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16050dda2b5e42e2b245dfc5f4a43532'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:58.829969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16050dda2b5e42e2b245dfc5f4a43532'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:58.830646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-40ebe939-9caa-44ba-a319-6290fe5f7996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16050dda2b5e42e2b245dfc5f4a43532'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:58.836960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 898/1830] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:24:58 2022] DELETE /identity/v3/users/16050dda2b5e42e2b245dfc5f4a43532 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:59.015946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4807c-03e2-4dc8-ae22-14d51e1a8e0f service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:59.027327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4807c-03e2-4dc8-ae22-14d51e1a8e0f service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:59.093412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:59.094561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.095148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.095568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] PATH_INFO: `/v3/projects/533cbce802584456b0e55a80c7cc291d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.097130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533cbce802584456b0e55a80c7cc291d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:59.099714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:59.157556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533cbce802584456b0e55a80c7cc291d', 'request_id': 'req-384d0862-62e3-4a37-a73d-ae36bfcf8b33'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:59.163429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533cbce802584456b0e55a80c7cc291d', 'request_id': 'req-384d0862-62e3-4a37-a73d-ae36bfcf8b33'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:59.170833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533cbce802584456b0e55a80c7cc291d', 'request_id': 'req-384d0862-62e3-4a37-a73d-ae36bfcf8b33'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:59.184177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] The token cache is being invalidate because project 533cbce802584456b0e55a80c7cc291d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:59.184470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:59.185089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-384d0862-62e3-4a37-a73d-ae36bfcf8b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:59.186586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 933/1831] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:24:59 2022] DELETE /identity/v3/projects/533cbce802584456b0e55a80c7cc291d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:59.193131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05c6d-efc3-4f19-b9ff-05a176e2a9cf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.193484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05c6d-efc3-4f19-b9ff-05a176e2a9cf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.193715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05c6d-efc3-4f19-b9ff-05a176e2a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.215019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ebd05c6d-efc3-4f19-b9ff-05a176e2a9cf None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:59.216259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ebd05c6d-efc3-4f19-b9ff-05a176e2a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:59.294765 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 899/1832] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:59.303494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ce60a-22b2-4437-83a4-79a0c9c79163 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.303903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ce60a-22b2-4437-83a4-79a0c9c79163 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.304303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ce60a-22b2-4437-83a4-79a0c9c79163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.325095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5e4ce60a-22b2-4437-83a4-79a0c9c79163 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:59.326432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5e4ce60a-22b2-4437-83a4-79a0c9c79163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:59.334857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 934/1833] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:59.339286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd05c6d-efc3-4f19-b9ff-05a176e2a9cf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:59.349300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd05c6d-efc3-4f19-b9ff-05a176e2a9cf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:59.353990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15d31-48dd-4a48-b968-0d445f2cfbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:59.354603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15d31-48dd-4a48-b968-0d445f2cfbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.354987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15d31-48dd-4a48-b968-0d445f2cfbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.355263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15d31-48dd-4a48-b968-0d445f2cfbd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.355912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15d31-48dd-4a48-b968-0d445f2cfbd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:59.356216 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15d31-48dd-4a48-b968-0d445f2cfbd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:59.357843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15d31-48dd-4a48-b968-0d445f2cfbd8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:59.369709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 900/1834] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:59.375187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ce60a-22b2-4437-83a4-79a0c9c79163 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:59.388368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ce60a-22b2-4437-83a4-79a0c9c79163 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:59.394079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af6ad1-55c1-4066-83a4-b8c53e609cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:59.394704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af6ad1-55c1-4066-83a4-b8c53e609cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.395012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af6ad1-55c1-4066-83a4-b8c53e609cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.395315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af6ad1-55c1-4066-83a4-b8c53e609cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.395995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af6ad1-55c1-4066-83a4-b8c53e609cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:59.397903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af6ad1-55c1-4066-83a4-b8c53e609cc2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:59.413909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:59.430504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 935/1835] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:24:59 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:24:59.434650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15d31-48dd-4a48-b968-0d445f2cfbd8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:59.447884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15d31-48dd-4a48-b968-0d445f2cfbd8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:59.481780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:59.519008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19350eed-a62c-42b6-8d3a-6b9db5da8244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:59.519643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350eed-a62c-42b6-8d3a-6b9db5da8244 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.519925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350eed-a62c-42b6-8d3a-6b9db5da8244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.520199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350eed-a62c-42b6-8d3a-6b9db5da8244 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.520839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19350eed-a62c-42b6-8d3a-6b9db5da8244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:59.522771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19350eed-a62c-42b6-8d3a-6b9db5da8244 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:59.562031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 901/1836] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:24:59 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:59.563055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af6ad1-55c1-4066-83a4-b8c53e609cc2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:59.576071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af6ad1-55c1-4066-83a4-b8c53e609cc2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:59.580909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce518d73-0eca-4150-85ce-4878ea1745f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:59.581388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce518d73-0eca-4150-85ce-4878ea1745f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.581667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce518d73-0eca-4150-85ce-4878ea1745f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.581937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce518d73-0eca-4150-85ce-4878ea1745f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.582583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce518d73-0eca-4150-85ce-4878ea1745f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:59.584193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce518d73-0eca-4150-85ce-4878ea1745f2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:59.594753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 936/1837] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:59.598911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19350eed-a62c-42b6-8d3a-6b9db5da8244 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:59.609119 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19350eed-a62c-42b6-8d3a-6b9db5da8244 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:59.614379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b493db-0358-478e-8b50-81a0f521217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:59.615065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b493db-0358-478e-8b50-81a0f521217c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.615332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b493db-0358-478e-8b50-81a0f521217c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.615645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b493db-0358-478e-8b50-81a0f521217c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.616340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b493db-0358-478e-8b50-81a0f521217c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:59.618127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b493db-0358-478e-8b50-81a0f521217c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:59.629301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 902/1838] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:59.633318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce518d73-0eca-4150-85ce-4878ea1745f2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:59.643386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce518d73-0eca-4150-85ce-4878ea1745f2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:59.648362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd6f44-a79b-4858-984d-e3f6747327fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:59.649008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6f44-a79b-4858-984d-e3f6747327fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.649287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6f44-a79b-4858-984d-e3f6747327fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.649557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6f44-a79b-4858-984d-e3f6747327fd admin admin] PATH_INFO: `/v3/projects/e699b58e5b884f32850c7a596a5030f1/users/109ed80cbe114093981050ab1b3683cb/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.666433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd6f44-a79b-4858-984d-e3f6747327fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e699b58e5b884f32850c7a596a5030f1, user_id=109ed80cbe114093981050ab1b3683cb, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:59.669151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd6f44-a79b-4858-984d-e3f6747327fd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:59.682985 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 937/1839] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:24:59 2022] PUT /identity/v3/projects/e699b58e5b884f32850c7a596a5030f1/users/109ed80cbe114093981050ab1b3683cb/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:59.693072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e784b-40d1-4f15-9365-7e1e963751f4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.693554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e784b-40d1-4f15-9365-7e1e963751f4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.693750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e784b-40d1-4f15-9365-7e1e963751f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.723189 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-696e784b-40d1-4f15-9365-7e1e963751f4 None None] MFA Rules not processed for user `109ed80cbe114093981050ab1b3683cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:59.724432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-696e784b-40d1-4f15-9365-7e1e963751f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:59.792608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 903/1840] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:59.803939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd6f44-a79b-4858-984d-e3f6747327fd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:59.805728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2efd6f44-a79b-4858-984d-e3f6747327fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:59.884158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd6f44-a79b-4858-984d-e3f6747327fd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:59.889743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32279bc-c5f2-4caa-bb6f-e0a6df048fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:59.890609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32279bc-c5f2-4caa-bb6f-e0a6df048fcd service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:59.890890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32279bc-c5f2-4caa-bb6f-e0a6df048fcd service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:59.891164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32279bc-c5f2-4caa-bb6f-e0a6df048fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:59.900033 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32279bc-c5f2-4caa-bb6f-e0a6df048fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:59.901870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32279bc-c5f2-4caa-bb6f-e0a6df048fcd service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:59.912518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 938/1841] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:24:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:00.894280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e784b-40d1-4f15-9365-7e1e963751f4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:00.895826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-696e784b-40d1-4f15-9365-7e1e963751f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:00.966575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e784b-40d1-4f15-9365-7e1e963751f4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:00.972107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:00.973056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:00.973355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:00.973761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] PATH_INFO: `/v3/users/286a1f5b29374410985404512c39f8b8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:00.975411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=286a1f5b29374410985404512c39f8b8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:00.977562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:01.034151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:01.037731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '286a1f5b29374410985404512c39f8b8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.047486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '286a1f5b29374410985404512c39f8b8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.059580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '286a1f5b29374410985404512c39f8b8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.068062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '286a1f5b29374410985404512c39f8b8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.068872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '286a1f5b29374410985404512c39f8b8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.075185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 904/1842] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:00 2022] DELETE /identity/v3/users/286a1f5b29374410985404512c39f8b8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:01.079858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d57f3-53dd-4909-8265-fa214917bfe1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.080417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d57f3-53dd-4909-8265-fa214917bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.080515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d57f3-53dd-4909-8265-fa214917bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:01.100459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-eb2d57f3-53dd-4909-8265-fa214917bfe1 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:01.101818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eb2d57f3-53dd-4909-8265-fa214917bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:01.166105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 939/1843] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:01.177337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:01.179021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:01.246439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2634fcb-8541-4b3c-8e96-43d75af1bd58 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:01.250425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48dae8-69f2-4134-8fc5-1baa8b382297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:01.251164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48dae8-69f2-4134-8fc5-1baa8b382297 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.251438 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48dae8-69f2-4134-8fc5-1baa8b382297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.251705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48dae8-69f2-4134-8fc5-1baa8b382297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:01.260748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48dae8-69f2-4134-8fc5-1baa8b382297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:01.262166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48dae8-69f2-4134-8fc5-1baa8b382297 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:01.271357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 905/1844] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:01.558913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d57f3-53dd-4909-8265-fa214917bfe1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:01.560938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eb2d57f3-53dd-4909-8265-fa214917bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:01.580259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d57f3-53dd-4909-8265-fa214917bfe1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:01.586869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:01.587762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.588349 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.588510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] PATH_INFO: `/v3/projects/4cc8c00ac89f46a7b4d1b4bef200600a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:01.589943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc8c00ac89f46a7b4d1b4bef200600a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:01.592126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:01.639578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:01.650671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc8c00ac89f46a7b4d1b4bef200600a', 'request_id': 'req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.659580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc8c00ac89f46a7b4d1b4bef200600a', 'request_id': 'req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.669095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc8c00ac89f46a7b4d1b4bef200600a', 'request_id': 'req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.683368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] The token cache is being invalidate because project 4cc8c00ac89f46a7b4d1b4bef200600a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:01.683824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.684676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.686329 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 940/1845] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:01 2022] DELETE /identity/v3/projects/4cc8c00ac89f46a7b4d1b4bef200600a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:01.690338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48dae8-69f2-4134-8fc5-1baa8b382297 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:01.700741 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48dae8-69f2-4134-8fc5-1baa8b382297 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:01.763000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:01.763646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.763917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.764171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] PATH_INFO: `/v3/users/9986e51e12dc4ad3b1f355b5d67b711f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:01.765438 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9986e51e12dc4ad3b1f355b5d67b711f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:01.767616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:01.822989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9986e51e12dc4ad3b1f355b5d67b711f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.836564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9986e51e12dc4ad3b1f355b5d67b711f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.852287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:01.854200 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:01.857003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:01.864155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9986e51e12dc4ad3b1f355b5d67b711f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.869482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2c0a-5418-4edb-ac6e-521e1283d16e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:01.873626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9986e51e12dc4ad3b1f355b5d67b711f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.874332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51b01104-f77d-4462-8d68-64cc4602e73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9986e51e12dc4ad3b1f355b5d67b711f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.876780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:01.877425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.878483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.878483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] PATH_INFO: `/v3/users/ea765d2dbdec49d4863b597c8096d2b1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:01.879185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea765d2dbdec49d4863b597c8096d2b1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:01.881220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 906/1846] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:01 2022] DELETE /identity/v3/users/9986e51e12dc4ad3b1f355b5d67b711f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:01.881368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:01.958925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea765d2dbdec49d4863b597c8096d2b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.968035 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea765d2dbdec49d4863b597c8096d2b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.977666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea765d2dbdec49d4863b597c8096d2b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.978425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea765d2dbdec49d4863b597c8096d2b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.992324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea765d2dbdec49d4863b597c8096d2b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.009033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1509-88eb-4193-8919-7f788c91c70c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.009033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1509-88eb-4193-8919-7f788c91c70c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.009612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1509-88eb-4193-8919-7f788c91c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.012139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 941/1847] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:01 2022] DELETE /identity/v3/users/ea765d2dbdec49d4863b597c8096d2b1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:02.031912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-36db1509-88eb-4193-8919-7f788c91c70c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:02.033313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-36db1509-88eb-4193-8919-7f788c91c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:02.127917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 907/1848] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:02.137775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.139242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:02.209020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d972996-de6f-4c6c-b997-4968510dab67 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.213311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd3ca0-a4d7-4aae-be1c-f2a2448b505d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.213999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd3ca0-a4d7-4aae-be1c-f2a2448b505d service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.214484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd3ca0-a4d7-4aae-be1c-f2a2448b505d service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.214787 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd3ca0-a4d7-4aae-be1c-f2a2448b505d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.225462 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd3ca0-a4d7-4aae-be1c-f2a2448b505d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.227045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1509-88eb-4193-8919-7f788c91c70c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.228446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-36db1509-88eb-4193-8919-7f788c91c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:02.235307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd3ca0-a4d7-4aae-be1c-f2a2448b505d service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.249933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1509-88eb-4193-8919-7f788c91c70c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.257983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.258934 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.263176 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 942/1849] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:02.269972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.270889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] PATH_INFO: `/v3/projects/b75ecee0896a4283bdfd130663d9a930` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.272722 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75ecee0896a4283bdfd130663d9a930)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.274832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.330691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75ecee0896a4283bdfd130663d9a930', 'request_id': 'req-15d82d7d-bef9-4d48-a566-57861c29266d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.340086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75ecee0896a4283bdfd130663d9a930', 'request_id': 'req-15d82d7d-bef9-4d48-a566-57861c29266d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.347465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75ecee0896a4283bdfd130663d9a930', 'request_id': 'req-15d82d7d-bef9-4d48-a566-57861c29266d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.359635 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] The token cache is being invalidate because project b75ecee0896a4283bdfd130663d9a930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:02.360125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.361157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.362667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 908/1850] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:02 2022] DELETE /identity/v3/projects/b75ecee0896a4283bdfd130663d9a930 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:02.367341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd3ca0-a4d7-4aae-be1c-f2a2448b505d service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.379166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd3ca0-a4d7-4aae-be1c-f2a2448b505d service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.440214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:02.463038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.463859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.464208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.464565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] PATH_INFO: `/v3/users/ae58f79c4e0040c7a1a13004269e6375` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.465857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae58f79c4e0040c7a1a13004269e6375)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.467912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.521627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae58f79c4e0040c7a1a13004269e6375'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.530610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae58f79c4e0040c7a1a13004269e6375'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.538884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae58f79c4e0040c7a1a13004269e6375'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.539778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae58f79c4e0040c7a1a13004269e6375'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.552828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae58f79c4e0040c7a1a13004269e6375'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.559292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 943/1851] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:02 2022] DELETE /identity/v3/users/ae58f79c4e0040c7a1a13004269e6375 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:02.615178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.617041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:02.636007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d82d7d-bef9-4d48-a566-57861c29266d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.706161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.706867 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.707197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.707476 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] PATH_INFO: `/v3/projects/28fc217840b7452fb046312ef6bcd6e7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.708618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=28fc217840b7452fb046312ef6bcd6e7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.711470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.725125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:02.752308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.754799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:02.770747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18292e-8204-4d15-8934-c3762ee4267a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.780046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28fc217840b7452fb046312ef6bcd6e7', 'request_id': 'req-b58be45f-42bd-47b6-b432-f593ce020f6e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.791117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28fc217840b7452fb046312ef6bcd6e7', 'request_id': 'req-b58be45f-42bd-47b6-b432-f593ce020f6e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.798930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28fc217840b7452fb046312ef6bcd6e7', 'request_id': 'req-b58be45f-42bd-47b6-b432-f593ce020f6e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.812265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] The token cache is being invalidate because project 28fc217840b7452fb046312ef6bcd6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:02.812556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.813367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.815432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 909/1852] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:02 2022] DELETE /identity/v3/projects/28fc217840b7452fb046312ef6bcd6e7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:02.820492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.820670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:02.842873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.843652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.844033 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.844578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] PATH_INFO: `/v3/users/109ed80cbe114093981050ab1b3683cb` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.845916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] RBAC: Authorizing `identity:delete_user(user_id=109ed80cbe114093981050ab1b3683cb)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.848227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.919657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109ed80cbe114093981050ab1b3683cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.923465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58be45f-42bd-47b6-b432-f593ce020f6e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.928837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.929032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109ed80cbe114093981050ab1b3683cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.929654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.929939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.930239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] PATH_INFO: `/v3/users/426f36a2a2b046e8aa1c6254c51bd8d9` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.931378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426f36a2a2b046e8aa1c6254c51bd8d9)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.933301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.936532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109ed80cbe114093981050ab1b3683cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.937550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109ed80cbe114093981050ab1b3683cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.939059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:02.953408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109ed80cbe114093981050ab1b3683cb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.959901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 944/1853] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:02 2022] DELETE /identity/v3/users/109ed80cbe114093981050ab1b3683cb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:02.960689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.962131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:02.985323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426f36a2a2b046e8aa1c6254c51bd8d9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:02.993001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426f36a2a2b046e8aa1c6254c51bd8d9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.007242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426f36a2a2b046e8aa1c6254c51bd8d9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.018679 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426f36a2a2b046e8aa1c6254c51bd8d9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.019574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2edf7c46-289a-4950-921f-fa6da57222b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426f36a2a2b046e8aa1c6254c51bd8d9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.026016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 910/1854] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:02 2022] DELETE /identity/v3/users/426f36a2a2b046e8aa1c6254c51bd8d9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:03.029275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42f1c-dc5c-46cf-b0c1-057c92d7fb2e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.029275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42f1c-dc5c-46cf-b0c1-057c92d7fb2e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.029275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec42f1c-dc5c-46cf-b0c1-057c92d7fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.029866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e715cd4-9268-44b5-8209-79584a9041af admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.048405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-eec42f1c-dc5c-46cf-b0c1-057c92d7fb2e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:03.049689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eec42f1c-dc5c-46cf-b0c1-057c92d7fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:03.060433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:03.102786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.104088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.104088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.104712 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] PATH_INFO: `/v3/projects/d1091f49ff14482e934e6142e532c563` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.106076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1091f49ff14482e934e6142e532c563)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.108266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.140488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 911/1855] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:03.151723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42f1c-dc5c-46cf-b0c1-057c92d7fb2e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.153429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eec42f1c-dc5c-46cf-b0c1-057c92d7fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:03.176544 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1091f49ff14482e934e6142e532c563', 'request_id': 'req-e371383c-9769-48f8-9df1-3da3554477fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.194783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1091f49ff14482e934e6142e532c563', 'request_id': 'req-e371383c-9769-48f8-9df1-3da3554477fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.204342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1091f49ff14482e934e6142e532c563', 'request_id': 'req-e371383c-9769-48f8-9df1-3da3554477fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.245499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] The token cache is being invalidate because project d1091f49ff14482e934e6142e532c563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:03.249593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.251238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e371383c-9769-48f8-9df1-3da3554477fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.253352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec42f1c-dc5c-46cf-b0c1-057c92d7fb2e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.254056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 945/1856] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:02 2022] DELETE /identity/v3/projects/d1091f49ff14482e934e6142e532c563 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:03.261386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca4f70-46a6-4add-907c-d7cdc405e21b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.261721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca4f70-46a6-4add-907c-d7cdc405e21b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.263142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca4f70-46a6-4add-907c-d7cdc405e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.288331 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b6ca4f70-46a6-4add-907c-d7cdc405e21b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:03.289575 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b6ca4f70-46a6-4add-907c-d7cdc405e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:03.333831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da7b4d-c3e0-4633-baa8-a891e70f032b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.335149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7b4d-c3e0-4633-baa8-a891e70f032b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.335443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7b4d-c3e0-4633-baa8-a891e70f032b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.335630 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:03.335748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7b4d-c3e0-4633-baa8-a891e70f032b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.338497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-47da7b4d-c3e0-4633-baa8-a891e70f032b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:03.414951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 946/1857] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:03.422042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca4f70-46a6-4add-907c-d7cdc405e21b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.426198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b6ca4f70-46a6-4add-907c-d7cdc405e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:03.457007 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca4f70-46a6-4add-907c-d7cdc405e21b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.476956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.478124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.478631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.479244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] PATH_INFO: `/v3/projects/c5f9fd73a7be4fd6adeca340f87cb6d0` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.482013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f9fd73a7be4fd6adeca340f87cb6d0)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.504946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.514823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da7b4d-c3e0-4633-baa8-a891e70f032b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.516465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da7b4d-c3e0-4633-baa8-a891e70f032b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.529399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 912/1858] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:03.530898 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37e75-9d8b-4834-b341-d64017ae5d4c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.531250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37e75-9d8b-4834-b341-d64017ae5d4c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.531603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37e75-9d8b-4834-b341-d64017ae5d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.564905 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4bc37e75-9d8b-4834-b341-d64017ae5d4c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:03.567353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4bc37e75-9d8b-4834-b341-d64017ae5d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:03.570269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f9fd73a7be4fd6adeca340f87cb6d0', 'request_id': 'req-2ad671ef-10ac-4bd5-b25f-e771102e28d5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.580424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f9fd73a7be4fd6adeca340f87cb6d0', 'request_id': 'req-2ad671ef-10ac-4bd5-b25f-e771102e28d5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.589079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f9fd73a7be4fd6adeca340f87cb6d0', 'request_id': 'req-2ad671ef-10ac-4bd5-b25f-e771102e28d5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.592122 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:03.611445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] The token cache is being invalidate because project c5f9fd73a7be4fd6adeca340f87cb6d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:03.611847 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.612480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.614981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 947/1859] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:03 2022] DELETE /identity/v3/projects/c5f9fd73a7be4fd6adeca340f87cb6d0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:03.619325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.621101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:03.653254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 913/1860] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:03.657675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc37e75-9d8b-4834-b341-d64017ae5d4c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.667871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc37e75-9d8b-4834-b341-d64017ae5d4c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.674208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03780d2d-5aec-4362-97e8-7a6d19247ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.674959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03780d2d-5aec-4362-97e8-7a6d19247ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.675310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03780d2d-5aec-4362-97e8-7a6d19247ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.675806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03780d2d-5aec-4362-97e8-7a6d19247ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.676469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03780d2d-5aec-4362-97e8-7a6d19247ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:03.676946 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03780d2d-5aec-4362-97e8-7a6d19247ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.679185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03780d2d-5aec-4362-97e8-7a6d19247ea7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.696303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 914/1861] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:25:03.701434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03780d2d-5aec-4362-97e8-7a6d19247ea7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.714198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03780d2d-5aec-4362-97e8-7a6d19247ea7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.720145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32e7aa-c1f3-4e91-8091-129a79f48c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.721802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32e7aa-c1f3-4e91-8091-129a79f48c0a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.722085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32e7aa-c1f3-4e91-8091-129a79f48c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.722439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32e7aa-c1f3-4e91-8091-129a79f48c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.723499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32e7aa-c1f3-4e91-8091-129a79f48c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.725116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad671ef-10ac-4bd5-b25f-e771102e28d5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.725915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32e7aa-c1f3-4e91-8091-129a79f48c0a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.730877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.731398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.731695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.732178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] PATH_INFO: `/v3/users/c62ed35018404240bb83f4107fa49040` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.733123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62ed35018404240bb83f4107fa49040)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.735270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.762165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 915/1862] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:03 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:03.766914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32e7aa-c1f3-4e91-8091-129a79f48c0a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.801475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:03.805603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62ed35018404240bb83f4107fa49040'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.818747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62ed35018404240bb83f4107fa49040'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.828823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62ed35018404240bb83f4107fa49040'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.829995 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62ed35018404240bb83f4107fa49040'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.850752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62ed35018404240bb83f4107fa49040'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:03.856399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32e7aa-c1f3-4e91-8091-129a79f48c0a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.857279 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 948/1863] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:03 2022] DELETE /identity/v3/users/c62ed35018404240bb83f4107fa49040 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:03.914282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.915750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:03.947886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0cf04-9436-4967-b64f-592e3b3d1900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.949131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0cf04-9436-4967-b64f-592e3b3d1900 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.951733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0cf04-9436-4967-b64f-592e3b3d1900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.952097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0cf04-9436-4967-b64f-592e3b3d1900 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.953096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0cf04-9436-4967-b64f-592e3b3d1900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.955509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0cf04-9436-4967-b64f-592e3b3d1900 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.982490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 916/1864] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:03 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:03.987009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0cf04-9436-4967-b64f-592e3b3d1900 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.988647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c3f0cf04-9436-4967-b64f-592e3b3d1900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.001471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0cf04-9436-4967-b64f-592e3b3d1900 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.007840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4cec5-dde7-4ffa-8ae9-a438ef2f3ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.008173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b021657-8667-4f96-87c3-f40daacd06fe admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.009023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4cec5-dde7-4ffa-8ae9-a438ef2f3ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.009445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4cec5-dde7-4ffa-8ae9-a438ef2f3ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.009860 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4cec5-dde7-4ffa-8ae9-a438ef2f3ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.011415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4cec5-dde7-4ffa-8ae9-a438ef2f3ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.013570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.014080 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4cec5-dde7-4ffa-8ae9-a438ef2f3ebe admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.014249 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.014580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.014909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] PATH_INFO: `/v3/projects/e699b58e5b884f32850c7a596a5030f1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.019547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e699b58e5b884f32850c7a596a5030f1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.022093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.028233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 917/1865] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:04.033629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4cec5-dde7-4ffa-8ae9-a438ef2f3ebe admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.045121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4cec5-dde7-4ffa-8ae9-a438ef2f3ebe admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.056077 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b3e73-7a7a-4945-be58-3b67be40e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.056909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3e73-7a7a-4945-be58-3b67be40e958 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.057199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3e73-7a7a-4945-be58-3b67be40e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.057470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3e73-7a7a-4945-be58-3b67be40e958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.058128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b3e73-7a7a-4945-be58-3b67be40e958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.059779 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b3e73-7a7a-4945-be58-3b67be40e958 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.078940 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 918/1866] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:04.082927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b3e73-7a7a-4945-be58-3b67be40e958 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.088862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:04.090740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e699b58e5b884f32850c7a596a5030f1', 'request_id': 'req-d08ca73d-f95d-4348-bdf4-6653110e27ba'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.096110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b3e73-7a7a-4945-be58-3b67be40e958 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.097626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e699b58e5b884f32850c7a596a5030f1', 'request_id': 'req-d08ca73d-f95d-4348-bdf4-6653110e27ba'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.105039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e699b58e5b884f32850c7a596a5030f1', 'request_id': 'req-d08ca73d-f95d-4348-bdf4-6653110e27ba'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.123672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] The token cache is being invalidate because project e699b58e5b884f32850c7a596a5030f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:04.124784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.125730 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d08ca73d-f95d-4348-bdf4-6653110e27ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.127648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 949/1867] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:03 2022] DELETE /identity/v3/projects/e699b58e5b884f32850c7a596a5030f1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:04.132291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa981a-cee6-47a8-b5b3-8d1cd1580b49 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.132594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa981a-cee6-47a8-b5b3-8d1cd1580b49 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.133444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa981a-cee6-47a8-b5b3-8d1cd1580b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.161788 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6daa981a-cee6-47a8-b5b3-8d1cd1580b49 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:04.163105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6daa981a-cee6-47a8-b5b3-8d1cd1580b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.169775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08de65-5ade-4c92-bb2b-5a6e6ddba35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.170546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08de65-5ade-4c92-bb2b-5a6e6ddba35e admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.170856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08de65-5ade-4c92-bb2b-5a6e6ddba35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.171134 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08de65-5ade-4c92-bb2b-5a6e6ddba35e admin admin] PATH_INFO: `/v3/projects/13451d44792b47a38051c1c0a4394385/users/5fa629fcf4394aaaa6ca3a9d9fb64e51/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.171894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 950/1868] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:04.181866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb3e42-e8de-45e4-97a1-e4dfabef99e7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.182406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb3e42-e8de-45e4-97a1-e4dfabef99e7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.182835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb3e42-e8de-45e4-97a1-e4dfabef99e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.194687 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08de65-5ade-4c92-bb2b-5a6e6ddba35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13451d44792b47a38051c1c0a4394385, user_id=5fa629fcf4394aaaa6ca3a9d9fb64e51, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.202433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08de65-5ade-4c92-bb2b-5a6e6ddba35e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.206003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d9cb3e42-e8de-45e4-97a1-e4dfabef99e7 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:04.207764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d9cb3e42-e8de-45e4-97a1-e4dfabef99e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.223048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 951/1869] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:04.224113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb3e42-e8de-45e4-97a1-e4dfabef99e7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.225420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d9cb3e42-e8de-45e4-97a1-e4dfabef99e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.226864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 919/1870] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:04 2022] PUT /identity/v3/projects/13451d44792b47a38051c1c0a4394385/users/5fa629fcf4394aaaa6ca3a9d9fb64e51/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:04.227886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08de65-5ade-4c92-bb2b-5a6e6ddba35e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.237984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb3e42-e8de-45e4-97a1-e4dfabef99e7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.274483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:04.296570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08de65-5ade-4c92-bb2b-5a6e6ddba35e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.299349 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.300058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.300344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.300619 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] PATH_INFO: `/v3/projects/8cf9fde7a7be40518acbab9f2ce762a8` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.301825 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf9fde7a7be40518acbab9f2ce762a8)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.302551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b9194-80aa-417c-a0f2-87f624a1569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.303386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b9194-80aa-417c-a0f2-87f624a1569c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.303781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.303993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b9194-80aa-417c-a0f2-87f624a1569c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.304445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b9194-80aa-417c-a0f2-87f624a1569c admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.305110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b9194-80aa-417c-a0f2-87f624a1569c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:04.305417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b9194-80aa-417c-a0f2-87f624a1569c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.307086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b9194-80aa-417c-a0f2-87f624a1569c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.319224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 920/1871] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:04.320460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd3e24-195a-4f23-a8a3-59c546b5887c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.320739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd3e24-195a-4f23-a8a3-59c546b5887c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.321027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd3e24-195a-4f23-a8a3-59c546b5887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.353357 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b9fd3e24-195a-4f23-a8a3-59c546b5887c None None] MFA Rules not processed for user `5fa629fcf4394aaaa6ca3a9d9fb64e51`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:04.354587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b9fd3e24-195a-4f23-a8a3-59c546b5887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.357227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf9fde7a7be40518acbab9f2ce762a8', 'request_id': 'req-89b0ac78-e241-424e-a982-0c216a33b619'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.363810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf9fde7a7be40518acbab9f2ce762a8', 'request_id': 'req-89b0ac78-e241-424e-a982-0c216a33b619'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.370206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf9fde7a7be40518acbab9f2ce762a8', 'request_id': 'req-89b0ac78-e241-424e-a982-0c216a33b619'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.385130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] The token cache is being invalidate because project 8cf9fde7a7be40518acbab9f2ce762a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:04.385385 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.386042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.387587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 952/1872] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:04 2022] DELETE /identity/v3/projects/8cf9fde7a7be40518acbab9f2ce762a8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:04.388436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.389731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.429226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 921/1873] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:04.431935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8813e-35ef-404f-a2eb-825ec2659c8b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.432489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8813e-35ef-404f-a2eb-825ec2659c8b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.433005 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8813e-35ef-404f-a2eb-825ec2659c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.461040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0ef8813e-35ef-404f-a2eb-825ec2659c8b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:04.462567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0ef8813e-35ef-404f-a2eb-825ec2659c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.469859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0ac78-e241-424e-a982-0c216a33b619 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.474327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 922/1874] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:04.475009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8813e-35ef-404f-a2eb-825ec2659c8b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.476365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0ef8813e-35ef-404f-a2eb-825ec2659c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.482615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b888b-abb0-4ccf-aa36-8b7eb7b957d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.483432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:04.483656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b888b-abb0-4ccf-aa36-8b7eb7b957d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.483935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b888b-abb0-4ccf-aa36-8b7eb7b957d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.484287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b888b-abb0-4ccf-aa36-8b7eb7b957d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.485240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b888b-abb0-4ccf-aa36-8b7eb7b957d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.488534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b888b-abb0-4ccf-aa36-8b7eb7b957d5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.524472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 953/1875] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:04 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:04.525697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223dc1e-3fca-405e-bd4e-799ff012ec61 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.527627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223dc1e-3fca-405e-bd4e-799ff012ec61 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.527941 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223dc1e-3fca-405e-bd4e-799ff012ec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.552742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b223dc1e-3fca-405e-bd4e-799ff012ec61 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:04.554113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b223dc1e-3fca-405e-bd4e-799ff012ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.583669 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8813e-35ef-404f-a2eb-825ec2659c8b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.619097 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:04.638659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 954/1876] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:04.639531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223dc1e-3fca-405e-bd4e-799ff012ec61 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.647859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e458ea-0039-417b-9f29-4d3c26d2be1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ea18d542ca24e39ac758f34ad65e7bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.648537 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e458ea-0039-417b-9f29-4d3c26d2be1e service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.648820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e458ea-0039-417b-9f29-4d3c26d2be1e service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.648935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223dc1e-3fca-405e-bd4e-799ff012ec61 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.649095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e458ea-0039-417b-9f29-4d3c26d2be1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.654564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6265a-7505-4648-9c17-af27751f3fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.656131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6265a-7505-4648-9c17-af27751f3fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.656978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6265a-7505-4648-9c17-af27751f3fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.657337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6265a-7505-4648-9c17-af27751f3fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.658167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6265a-7505-4648-9c17-af27751f3fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.662802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6265a-7505-4648-9c17-af27751f3fd5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.694265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 955/1877] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:04 2022] POST /identity/v3/users => generated 291 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:04.694265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6265a-7505-4648-9c17-af27751f3fd5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.704212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6265a-7505-4648-9c17-af27751f3fd5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.709944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38c7f-d3a5-4ab7-9b03-8644e3f8b1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.710573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38c7f-d3a5-4ab7-9b03-8644e3f8b1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.710938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38c7f-d3a5-4ab7-9b03-8644e3f8b1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.711318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38c7f-d3a5-4ab7-9b03-8644e3f8b1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.711868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38c7f-d3a5-4ab7-9b03-8644e3f8b1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:04.712222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38c7f-d3a5-4ab7-9b03-8644e3f8b1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.713966 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38c7f-d3a5-4ab7-9b03-8644e3f8b1b8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.729213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 956/1878] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:04.729976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38c7f-d3a5-4ab7-9b03-8644e3f8b1b8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.742761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e458ea-0039-417b-9f29-4d3c26d2be1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.744019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38c7f-d3a5-4ab7-9b03-8644e3f8b1b8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.747058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e458ea-0039-417b-9f29-4d3c26d2be1e service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.749247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d32ae0-cbc1-43ad-89f6-1141eb2a0385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.749940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d32ae0-cbc1-43ad-89f6-1141eb2a0385 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.750284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d32ae0-cbc1-43ad-89f6-1141eb2a0385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.750793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d32ae0-cbc1-43ad-89f6-1141eb2a0385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.751765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d32ae0-cbc1-43ad-89f6-1141eb2a0385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.754175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d32ae0-cbc1-43ad-89f6-1141eb2a0385 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.760865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 923/1879] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:04.761767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e458ea-0039-417b-9f29-4d3c26d2be1e service glance] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.777054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e458ea-0039-417b-9f29-4d3c26d2be1e service glance] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.780862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 957/1880] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:04.786101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70e2e4-05e2-4f94-b7a3-451d55c64980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.787647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70e2e4-05e2-4f94-b7a3-451d55c64980 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.788041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70e2e4-05e2-4f94-b7a3-451d55c64980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.788322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70e2e4-05e2-4f94-b7a3-451d55c64980 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.788677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d32ae0-cbc1-43ad-89f6-1141eb2a0385 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.789114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70e2e4-05e2-4f94-b7a3-451d55c64980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.792452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70e2e4-05e2-4f94-b7a3-451d55c64980 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.804384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d32ae0-cbc1-43ad-89f6-1141eb2a0385 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.818905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ef1bc-4637-45e6-9450-1e8f33f46489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.819764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef1bc-4637-45e6-9450-1e8f33f46489 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.820320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef1bc-4637-45e6-9450-1e8f33f46489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.820439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef1bc-4637-45e6-9450-1e8f33f46489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.821111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ef1bc-4637-45e6-9450-1e8f33f46489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.823213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ef1bc-4637-45e6-9450-1e8f33f46489 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.851524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 958/1881] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:25:04.856584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ef1bc-4637-45e6-9450-1e8f33f46489 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.860744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 924/1882] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:04 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:04.867538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70e2e4-05e2-4f94-b7a3-451d55c64980 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.880647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ef1bc-4637-45e6-9450-1e8f33f46489 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.955804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:05.006937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933488b7-5612-4434-b207-8e8f377fb018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.006937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933488b7-5612-4434-b207-8e8f377fb018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.006937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933488b7-5612-4434-b207-8e8f377fb018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.006937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933488b7-5612-4434-b207-8e8f377fb018 admin admin] PATH_INFO: `/v3/projects/779e318708bf4b2aa1a673a71a3a22ca/users/a72c681efabc48c183d5f916ba9a1ad5/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.011478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70e2e4-05e2-4f94-b7a3-451d55c64980 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.018327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a9fe5-631d-40d5-8054-6cf690108af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.019208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a9fe5-631d-40d5-8054-6cf690108af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.019297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a9fe5-631d-40d5-8054-6cf690108af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.019723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a9fe5-631d-40d5-8054-6cf690108af4 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.023379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a9fe5-631d-40d5-8054-6cf690108af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.023379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a9fe5-631d-40d5-8054-6cf690108af4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.028816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933488b7-5612-4434-b207-8e8f377fb018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779e318708bf4b2aa1a673a71a3a22ca, user_id=a72c681efabc48c183d5f916ba9a1ad5, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.032036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933488b7-5612-4434-b207-8e8f377fb018 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.051530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 959/1883] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:04 2022] PUT /identity/v3/projects/779e318708bf4b2aa1a673a71a3a22ca/users/a72c681efabc48c183d5f916ba9a1ad5/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:05.054758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 925/1884] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:04 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:05.058282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933488b7-5612-4434-b207-8e8f377fb018 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.063597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebd80c-dc7c-492d-b9c3-c2676c8a8e0b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.063890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebd80c-dc7c-492d-b9c3-c2676c8a8e0b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.064168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebd80c-dc7c-492d-b9c3-c2676c8a8e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.094418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3bebd80c-dc7c-492d-b9c3-c2676c8a8e0b None None] MFA Rules not processed for user `a72c681efabc48c183d5f916ba9a1ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:05.095878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3bebd80c-dc7c-492d-b9c3-c2676c8a8e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:05.135811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933488b7-5612-4434-b207-8e8f377fb018 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.140684 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f85d8-a307-4664-814e-eb460982cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.141861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f85d8-a307-4664-814e-eb460982cc27 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.141861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f85d8-a307-4664-814e-eb460982cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.142038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f85d8-a307-4664-814e-eb460982cc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.142644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f85d8-a307-4664-814e-eb460982cc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.144320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f85d8-a307-4664-814e-eb460982cc27 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.154587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 960/1885] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:05.158609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f85d8-a307-4664-814e-eb460982cc27 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.165033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 926/1886] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:05.169195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f85d8-a307-4664-814e-eb460982cc27 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.170020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebd80c-dc7c-492d-b9c3-c2676c8a8e0b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.174054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b1a6-899e-4836-9c1d-acdf58f28e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.174675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b1a6-899e-4836-9c1d-acdf58f28e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.175006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b1a6-899e-4836-9c1d-acdf58f28e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.175326 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b1a6-899e-4836-9c1d-acdf58f28e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.175974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58b1a6-899e-4836-9c1d-acdf58f28e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.177581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58b1a6-899e-4836-9c1d-acdf58f28e34 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.182257 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebd80c-dc7c-492d-b9c3-c2676c8a8e0b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.190771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 961/1887] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:05.191800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5917d3-1ad4-4377-8c9a-ffac6b455a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.192557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5917d3-1ad4-4377-8c9a-ffac6b455a82 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.192875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5917d3-1ad4-4377-8c9a-ffac6b455a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.193095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b1a6-899e-4836-9c1d-acdf58f28e34 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.193349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5917d3-1ad4-4377-8c9a-ffac6b455a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.193777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5917d3-1ad4-4377-8c9a-ffac6b455a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.195806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5917d3-1ad4-4377-8c9a-ffac6b455a82 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.204655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b1a6-899e-4836-9c1d-acdf58f28e34 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.210507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e879d3c-187a-4ed1-b1d6-11c03b13e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.211209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879d3c-187a-4ed1-b1d6-11c03b13e74a admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.211491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879d3c-187a-4ed1-b1d6-11c03b13e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.211765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879d3c-187a-4ed1-b1d6-11c03b13e74a admin admin] PATH_INFO: `/v3/projects/1ab979e54ca040c8a1093d62164922f8/users/6cdaca05726744c3b57f34f4331a4eaf/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.216377 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:05.230764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 927/1888] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:05 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:05.233549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e879d3c-187a-4ed1-b1d6-11c03b13e74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab979e54ca040c8a1093d62164922f8, user_id=6cdaca05726744c3b57f34f4331a4eaf, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.233756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5917d3-1ad4-4377-8c9a-ffac6b455a82 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.236228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e879d3c-187a-4ed1-b1d6-11c03b13e74a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.253832 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 962/1889] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:05 2022] PUT /identity/v3/projects/1ab979e54ca040c8a1093d62164922f8/users/6cdaca05726744c3b57f34f4331a4eaf/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:05.265108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62227be8-da5c-4ac8-943d-d698ce68269d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.265403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62227be8-da5c-4ac8-943d-d698ce68269d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.265680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62227be8-da5c-4ac8-943d-d698ce68269d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.309005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-62227be8-da5c-4ac8-943d-d698ce68269d None None] MFA Rules not processed for user `6cdaca05726744c3b57f34f4331a4eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:05.312006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-62227be8-da5c-4ac8-943d-d698ce68269d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:05.316417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5917d3-1ad4-4377-8c9a-ffac6b455a82 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.357095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:05.391013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cda70-9982-44e7-bd03-0f765d4a7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.391509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cda70-9982-44e7-bd03-0f765d4a7036 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.391962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cda70-9982-44e7-bd03-0f765d4a7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.392240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cda70-9982-44e7-bd03-0f765d4a7036 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.393552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cda70-9982-44e7-bd03-0f765d4a7036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.395601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cda70-9982-44e7-bd03-0f765d4a7036 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.402987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 963/1890] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:05.414841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62227be8-da5c-4ac8-943d-d698ce68269d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.421707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 928/1891] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:05 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:05.425832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cda70-9982-44e7-bd03-0f765d4a7036 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.435948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cda70-9982-44e7-bd03-0f765d4a7036 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.441053 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a47104-1ebb-4089-91cc-fd56ebe5abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.441657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a47104-1ebb-4089-91cc-fd56ebe5abba admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.441935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a47104-1ebb-4089-91cc-fd56ebe5abba admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.442205 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a47104-1ebb-4089-91cc-fd56ebe5abba admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.442888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a47104-1ebb-4089-91cc-fd56ebe5abba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.444475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a47104-1ebb-4089-91cc-fd56ebe5abba admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.458424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 929/1892] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:25:05.459321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a47104-1ebb-4089-91cc-fd56ebe5abba admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.469120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62227be8-da5c-4ac8-943d-d698ce68269d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.470004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a47104-1ebb-4089-91cc-fd56ebe5abba admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.473029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e734f-0f11-4add-965f-288fe49ba29e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ea18d542ca24e39ac758f34ad65e7bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.473639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e734f-0f11-4add-965f-288fe49ba29e service glance] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.473932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e734f-0f11-4add-965f-288fe49ba29e service glance] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.474266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e734f-0f11-4add-965f-288fe49ba29e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.474827 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90afd29-53a8-4ef4-9a6a-6b4d2019b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.475468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90afd29-53a8-4ef4-9a6a-6b4d2019b897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.475745 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90afd29-53a8-4ef4-9a6a-6b4d2019b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.476017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90afd29-53a8-4ef4-9a6a-6b4d2019b897 admin admin] PATH_INFO: `/v3/projects/4c1fa40d389d4d1f92be00020695d772/users/1d05b33ae6d84342b6a3a1ae25c4b43b/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.484511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e734f-0f11-4add-965f-288fe49ba29e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.486146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e734f-0f11-4add-965f-288fe49ba29e service glance] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.492221 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90afd29-53a8-4ef4-9a6a-6b4d2019b897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1fa40d389d4d1f92be00020695d772, user_id=1d05b33ae6d84342b6a3a1ae25c4b43b, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.494896 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90afd29-53a8-4ef4-9a6a-6b4d2019b897 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.495767 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 964/1893] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:05.521405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e734f-0f11-4add-965f-288fe49ba29e service glance] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.522627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 930/1894] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:05 2022] PUT /identity/v3/projects/4c1fa40d389d4d1f92be00020695d772/users/1d05b33ae6d84342b6a3a1ae25c4b43b/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:05.536713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e734f-0f11-4add-965f-288fe49ba29e service glance] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.595971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ebc5a-003c-4a6c-9584-3b381e10998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.596842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ebc5a-003c-4a6c-9584-3b381e10998d admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.596842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ebc5a-003c-4a6c-9584-3b381e10998d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.597125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ebc5a-003c-4a6c-9584-3b381e10998d admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.597831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ebc5a-003c-4a6c-9584-3b381e10998d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.599515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ebc5a-003c-4a6c-9584-3b381e10998d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.613018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 965/1895] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:05.614366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90afd29-53a8-4ef4-9a6a-6b4d2019b897 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.625443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90afd29-53a8-4ef4-9a6a-6b4d2019b897 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.629956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b035f-2cba-42f5-918f-9e2733f46f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.630630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b035f-2cba-42f5-918f-9e2733f46f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.630950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b035f-2cba-42f5-918f-9e2733f46f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.631220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b035f-2cba-42f5-918f-9e2733f46f75 admin admin] PATH_INFO: `/v3/projects/4c1fa40d389d4d1f92be00020695d772/users/1d05b33ae6d84342b6a3a1ae25c4b43b/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.633247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b035f-2cba-42f5-918f-9e2733f46f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1fa40d389d4d1f92be00020695d772, user_id=1d05b33ae6d84342b6a3a1ae25c4b43b, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.635884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b035f-2cba-42f5-918f-9e2733f46f75 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.646457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 931/1896] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:05 2022] PUT /identity/v3/projects/4c1fa40d389d4d1f92be00020695d772/users/1d05b33ae6d84342b6a3a1ae25c4b43b/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:05.656601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112e8ee-a596-4418-9c60-b93645865311 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.656977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112e8ee-a596-4418-9c60-b93645865311 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.657343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112e8ee-a596-4418-9c60-b93645865311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.683976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:05.687079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b112e8ee-a596-4418-9c60-b93645865311 None None] MFA Rules not processed for user `1d05b33ae6d84342b6a3a1ae25c4b43b`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:05.688786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b112e8ee-a596-4418-9c60-b93645865311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:05.762477 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 966/1897] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:05.775606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b035f-2cba-42f5-918f-9e2733f46f75 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.777362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a73b035f-2cba-42f5-918f-9e2733f46f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:05.855387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b035f-2cba-42f5-918f-9e2733f46f75 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.860379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9ee9f-8221-4d03-8613-ec95e224964a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.861065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ee9f-8221-4d03-8613-ec95e224964a service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.861412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ee9f-8221-4d03-8613-ec95e224964a service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.862323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ee9f-8221-4d03-8613-ec95e224964a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.876165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9ee9f-8221-4d03-8613-ec95e224964a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.878028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9ee9f-8221-4d03-8613-ec95e224964a service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.889623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 932/1898] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:06.286896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112e8ee-a596-4418-9c60-b93645865311 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:06.296147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112e8ee-a596-4418-9c60-b93645865311 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:06.301415 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608e89-0c4c-41bc-882c-3083d8d68acc tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d05b33ae6d84342b6a3a1ae25c4b43b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c1fa40d389d4d1f92be00020695d772', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:06.302382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608e89-0c4c-41bc-882c-3083d8d68acc tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:06.302779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608e89-0c4c-41bc-882c-3083d8d68acc tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:06.303075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608e89-0c4c-41bc-882c-3083d8d68acc tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:06.303801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608e89-0c4c-41bc-882c-3083d8d68acc tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:06.304197 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608e89-0c4c-41bc-882c-3083d8d68acc tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:06.305885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608e89-0c4c-41bc-882c-3083d8d68acc tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:06.321419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 967/1899] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:06.323102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9ee9f-8221-4d03-8613-ec95e224964a service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:06.333298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9ee9f-8221-4d03-8613-ec95e224964a service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:06.339083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408a9f1-f13a-4452-9829-b5b90157d9d6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d05b33ae6d84342b6a3a1ae25c4b43b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c1fa40d389d4d1f92be00020695d772', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:06.339814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408a9f1-f13a-4452-9829-b5b90157d9d6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:06.340166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408a9f1-f13a-4452-9829-b5b90157d9d6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:06.340509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408a9f1-f13a-4452-9829-b5b90157d9d6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:06.341240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408a9f1-f13a-4452-9829-b5b90157d9d6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:06.343299 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408a9f1-f13a-4452-9829-b5b90157d9d6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:06.374061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 933/1900] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:06 2022] POST /identity/v3/projects => generated 354 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:06.378539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608e89-0c4c-41bc-882c-3083d8d68acc tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:06.390086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608e89-0c4c-41bc-882c-3083d8d68acc tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:06.454878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d05b33ae6d84342b6a3a1ae25c4b43b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c1fa40d389d4d1f92be00020695d772', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:06.455502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:06.455782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:06.456053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:06.456732 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:06.457034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:06.458603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:06.470433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 968/1901] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:06.509580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408a9f1-f13a-4452-9829-b5b90157d9d6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:06.526474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408a9f1-f13a-4452-9829-b5b90157d9d6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:06.533493 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d05b33ae6d84342b6a3a1ae25c4b43b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c1fa40d389d4d1f92be00020695d772', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:06.534096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:06.534392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:06.534694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] PATH_INFO: `/v3/projects/d0d273c6e06e478bb741e3cd5297abbc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:06.535972 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d0d273c6e06e478bb741e3cd5297abbc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:06.537937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:06.596180 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d273c6e06e478bb741e3cd5297abbc', 'request_id': 'req-db358296-a2ab-483c-9f38-498b4c16d9f6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.598700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:INSERT=7,keystone:DELETE=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:06.604436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d273c6e06e478bb741e3cd5297abbc', 'request_id': 'req-db358296-a2ab-483c-9f38-498b4c16d9f6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.611151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d273c6e06e478bb741e3cd5297abbc', 'request_id': 'req-db358296-a2ab-483c-9f38-498b4c16d9f6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.623100 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] The token cache is being invalidate because project d0d273c6e06e478bb741e3cd5297abbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:06.623415 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.624083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db358296-a2ab-483c-9f38-498b4c16d9f6 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.625597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 934/1902] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:06 2022] DELETE /identity/v3/projects/d0d273c6e06e478bb741e3cd5297abbc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:06.834445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:06.836426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:06.905344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666fd17-acd5-4225-92f6-1c82952d0b89 tempest-VolumeQuotaClassesTest-1402124127 tempest-VolumeQuotaClassesTest-1402124127-project-admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:06.934268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:06.971321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:06.971979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:06.972265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:06.972546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] PATH_INFO: `/v3/users/a72c681efabc48c183d5f916ba9a1ad5` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:06.973700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72c681efabc48c183d5f916ba9a1ad5)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:06.975711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.027542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72c681efabc48c183d5f916ba9a1ad5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.035949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72c681efabc48c183d5f916ba9a1ad5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.043403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72c681efabc48c183d5f916ba9a1ad5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.044047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72c681efabc48c183d5f916ba9a1ad5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.056064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72c681efabc48c183d5f916ba9a1ad5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.061949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 969/1903] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:06 2022] DELETE /identity/v3/users/a72c681efabc48c183d5f916ba9a1ad5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:07.066414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b645374-dca1-451f-8743-2ed3493a9683 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.066703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b645374-dca1-451f-8743-2ed3493a9683 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.067005 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b645374-dca1-451f-8743-2ed3493a9683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.086054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8b645374-dca1-451f-8743-2ed3493a9683 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:07.087290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8b645374-dca1-451f-8743-2ed3493a9683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:07.147954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 935/1904] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:07.158513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.160074 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:07.219651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e825a-351b-4465-ba40-0aef160ffa44 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.223456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c787846-b4b4-4ff9-a3cb-32e53ca5f992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.224070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787846-b4b4-4ff9-a3cb-32e53ca5f992 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.224346 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787846-b4b4-4ff9-a3cb-32e53ca5f992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.224617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787846-b4b4-4ff9-a3cb-32e53ca5f992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.233735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c787846-b4b4-4ff9-a3cb-32e53ca5f992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.235188 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c787846-b4b4-4ff9-a3cb-32e53ca5f992 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.244874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 970/1905] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:07.602005 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b645374-dca1-451f-8743-2ed3493a9683 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.603580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8b645374-dca1-451f-8743-2ed3493a9683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:07.618611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b645374-dca1-451f-8743-2ed3493a9683 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.625960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.627044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.627379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.627743 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] PATH_INFO: `/v3/projects/779e318708bf4b2aa1a673a71a3a22ca` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.629877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779e318708bf4b2aa1a673a71a3a22ca)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.632547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.681359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779e318708bf4b2aa1a673a71a3a22ca', 'request_id': 'req-c3e96a5b-7e43-478c-bef4-8544b5d2d634'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.690112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779e318708bf4b2aa1a673a71a3a22ca', 'request_id': 'req-c3e96a5b-7e43-478c-bef4-8544b5d2d634'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.696173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779e318708bf4b2aa1a673a71a3a22ca', 'request_id': 'req-c3e96a5b-7e43-478c-bef4-8544b5d2d634'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.708388 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] The token cache is being invalidate because project 779e318708bf4b2aa1a673a71a3a22ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:07.708678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.709327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.711009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 936/1906] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:07 2022] DELETE /identity/v3/projects/779e318708bf4b2aa1a673a71a3a22ca => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:07.715161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c787846-b4b4-4ff9-a3cb-32e53ca5f992 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.724820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c787846-b4b4-4ff9-a3cb-32e53ca5f992 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.770258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:07.785411 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.786071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.786380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.787008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] PATH_INFO: `/v3/users/1d05b33ae6d84342b6a3a1ae25c4b43b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.788162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d05b33ae6d84342b6a3a1ae25c4b43b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.790124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.840129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d05b33ae6d84342b6a3a1ae25c4b43b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.849800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d05b33ae6d84342b6a3a1ae25c4b43b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.860738 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d05b33ae6d84342b6a3a1ae25c4b43b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.861370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d05b33ae6d84342b6a3a1ae25c4b43b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.874295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0229457c-4ed0-4dbf-a3a6-c50768d407a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d05b33ae6d84342b6a3a1ae25c4b43b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:07.880762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 971/1907] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:07 2022] DELETE /identity/v3/users/1d05b33ae6d84342b6a3a1ae25c4b43b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:08.169205 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.170675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:08.184212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e96a5b-7e43-478c-bef4-8544b5d2d634 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.242744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808cff-b414-478b-ae06-652053933920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.243412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808cff-b414-478b-ae06-652053933920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.243692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808cff-b414-478b-ae06-652053933920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.243988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808cff-b414-478b-ae06-652053933920 admin admin] PATH_INFO: `/v3/projects/4c1fa40d389d4d1f92be00020695d772` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.245123 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808cff-b414-478b-ae06-652053933920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1fa40d389d4d1f92be00020695d772)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.247154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808cff-b414-478b-ae06-652053933920 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.254018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:08.303223 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03808cff-b414-478b-ae06-652053933920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1fa40d389d4d1f92be00020695d772', 'request_id': 'req-03808cff-b414-478b-ae06-652053933920'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.312172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03808cff-b414-478b-ae06-652053933920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1fa40d389d4d1f92be00020695d772', 'request_id': 'req-03808cff-b414-478b-ae06-652053933920'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.318002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03808cff-b414-478b-ae06-652053933920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1fa40d389d4d1f92be00020695d772', 'request_id': 'req-03808cff-b414-478b-ae06-652053933920'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.329590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03808cff-b414-478b-ae06-652053933920 admin admin] The token cache is being invalidate because project 4c1fa40d389d4d1f92be00020695d772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:08.329882 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03808cff-b414-478b-ae06-652053933920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.330605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03808cff-b414-478b-ae06-652053933920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.332255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 937/1908] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:08 2022] DELETE /identity/v3/projects/4c1fa40d389d4d1f92be00020695d772 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:08.338356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc22154-14e6-4122-956d-36878c019f5c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.338698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc22154-14e6-4122-956d-36878c019f5c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.339055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc22154-14e6-4122-956d-36878c019f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.360463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ddc22154-14e6-4122-956d-36878c019f5c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:08.363070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ddc22154-14e6-4122-956d-36878c019f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:08.439247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 972/1909] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:08.448982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac77500-71e3-4250-aff3-8ba4e4d6ef9c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.449378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac77500-71e3-4250-aff3-8ba4e4d6ef9c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.449744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac77500-71e3-4250-aff3-8ba4e4d6ef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.471121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-aac77500-71e3-4250-aff3-8ba4e4d6ef9c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:08.472461 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aac77500-71e3-4250-aff3-8ba4e4d6ef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:08.480347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 938/1910] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:08.484672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc22154-14e6-4122-956d-36878c019f5c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.494793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc22154-14e6-4122-956d-36878c019f5c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.499761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1040e-5fc5-47eb-97f5-4338f21dceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.500402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1040e-5fc5-47eb-97f5-4338f21dceea admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.500679 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1040e-5fc5-47eb-97f5-4338f21dceea admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.500990 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1040e-5fc5-47eb-97f5-4338f21dceea admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.501642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1040e-5fc5-47eb-97f5-4338f21dceea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:08.501947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1040e-5fc5-47eb-97f5-4338f21dceea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.503577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1040e-5fc5-47eb-97f5-4338f21dceea admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.515383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 973/1911] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:25:08.519918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac77500-71e3-4250-aff3-8ba4e4d6ef9c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.530754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac77500-71e3-4250-aff3-8ba4e4d6ef9c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.552604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126e675-b670-4b08-8168-2eaef76cb142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.552604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126e675-b670-4b08-8168-2eaef76cb142 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.552604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126e675-b670-4b08-8168-2eaef76cb142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.552604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126e675-b670-4b08-8168-2eaef76cb142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.553083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126e675-b670-4b08-8168-2eaef76cb142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.556147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126e675-b670-4b08-8168-2eaef76cb142 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.619406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 939/1912] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:08 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:08.620862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1040e-5fc5-47eb-97f5-4338f21dceea admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.635234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1040e-5fc5-47eb-97f5-4338f21dceea admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.674319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126e675-b670-4b08-8168-2eaef76cb142 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.676580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4126e675-b670-4b08-8168-2eaef76cb142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:08.699138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:08.714939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7c6a7-a633-4269-be9d-f58e8aebb643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.715948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7c6a7-a633-4269-be9d-f58e8aebb643 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.716520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7c6a7-a633-4269-be9d-f58e8aebb643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.716735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7c6a7-a633-4269-be9d-f58e8aebb643 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.717540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7c6a7-a633-4269-be9d-f58e8aebb643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.720220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7c6a7-a633-4269-be9d-f58e8aebb643 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.746290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 974/1913] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:08 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:08.748125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7c6a7-a633-4269-be9d-f58e8aebb643 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.755009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126e675-b670-4b08-8168-2eaef76cb142 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.758335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7c6a7-a633-4269-be9d-f58e8aebb643 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.760391 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.760391 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.760826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.760920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] PATH_INFO: `/v3/users/a3ac3e0e04254f6d9dbdc4a8bb2e9962` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.762049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ac3e0e04254f6d9dbdc4a8bb2e9962)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.764642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.766112 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb044508-8a60-46e1-a887-c6006d859466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.767383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044508-8a60-46e1-a887-c6006d859466 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.767687 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044508-8a60-46e1-a887-c6006d859466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.767967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044508-8a60-46e1-a887-c6006d859466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.768628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb044508-8a60-46e1-a887-c6006d859466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.771513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb044508-8a60-46e1-a887-c6006d859466 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.786914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 975/1914] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:25:08.792368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb044508-8a60-46e1-a887-c6006d859466 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.804044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb044508-8a60-46e1-a887-c6006d859466 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.809292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179c56e-fe71-4fd4-be2f-5fb25ace8e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.809968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179c56e-fe71-4fd4-be2f-5fb25ace8e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.810251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179c56e-fe71-4fd4-be2f-5fb25ace8e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.810527 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179c56e-fe71-4fd4-be2f-5fb25ace8e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.811381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179c56e-fe71-4fd4-be2f-5fb25ace8e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.813468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179c56e-fe71-4fd4-be2f-5fb25ace8e88 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.819517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ac3e0e04254f6d9dbdc4a8bb2e9962'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.824858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 976/1915] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:08.826388 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ac3e0e04254f6d9dbdc4a8bb2e9962'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.830790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179c56e-fe71-4fd4-be2f-5fb25ace8e88 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.835903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:08.841309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179c56e-fe71-4fd4-be2f-5fb25ace8e88 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.846377 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e137-63f0-4928-a547-0d3dd37dfdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.847071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ac3e0e04254f6d9dbdc4a8bb2e9962'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.847173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e137-63f0-4928-a547-0d3dd37dfdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.847352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e137-63f0-4928-a547-0d3dd37dfdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.847632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e137-63f0-4928-a547-0d3dd37dfdf5 admin admin] PATH_INFO: `/v3/projects/dbc3e11c85f64ce9ba6437d5a453b6fc/users/270d901ab93c4972a77d02514db81aae/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.856923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ac3e0e04254f6d9dbdc4a8bb2e9962'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.857694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d2ce3da9-8fe4-489a-aa7c-cf91df80be8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ac3e0e04254f6d9dbdc4a8bb2e9962'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:08.865967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 940/1916] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:08 2022] DELETE /identity/v3/users/a3ac3e0e04254f6d9dbdc4a8bb2e9962 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:08.867503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e137-63f0-4928-a547-0d3dd37dfdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc3e11c85f64ce9ba6437d5a453b6fc, user_id=270d901ab93c4972a77d02514db81aae, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.870248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df417e-8496-40ef-aac2-3221458ab9cb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.870530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df417e-8496-40ef-aac2-3221458ab9cb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.870623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e137-63f0-4928-a547-0d3dd37dfdf5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.870835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df417e-8496-40ef-aac2-3221458ab9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.885193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 977/1917] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:08 2022] PUT /identity/v3/projects/dbc3e11c85f64ce9ba6437d5a453b6fc/users/270d901ab93c4972a77d02514db81aae/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:08.895529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20671b56-3e26-4e7d-82f7-7c0cbfc82838 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.895933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20671b56-3e26-4e7d-82f7-7c0cbfc82838 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.896213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20671b56-3e26-4e7d-82f7-7c0cbfc82838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.898959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d1df417e-8496-40ef-aac2-3221458ab9cb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:08.900183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d1df417e-8496-40ef-aac2-3221458ab9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:08.924321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-20671b56-3e26-4e7d-82f7-7c0cbfc82838 None None] MFA Rules not processed for user `270d901ab93c4972a77d02514db81aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:08.925520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-20671b56-3e26-4e7d-82f7-7c0cbfc82838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:08.961098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 941/1918] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:08.971079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df417e-8496-40ef-aac2-3221458ab9cb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.973027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d1df417e-8496-40ef-aac2-3221458ab9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:08.991911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 978/1919] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:08.996483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20671b56-3e26-4e7d-82f7-7c0cbfc82838 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.998204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-20671b56-3e26-4e7d-82f7-7c0cbfc82838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:09.011891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20671b56-3e26-4e7d-82f7-7c0cbfc82838 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.016736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091add73-83cb-4c30-804d-9e5b8c7ebefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.017350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091add73-83cb-4c30-804d-9e5b8c7ebefc admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.017633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091add73-83cb-4c30-804d-9e5b8c7ebefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.018033 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091add73-83cb-4c30-804d-9e5b8c7ebefc admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.018679 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091add73-83cb-4c30-804d-9e5b8c7ebefc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.020604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091add73-83cb-4c30-804d-9e5b8c7ebefc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.033857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df417e-8496-40ef-aac2-3221458ab9cb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.037619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1e981-9ce7-4584-8965-b2a95a33ec3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.038326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1e981-9ce7-4584-8965-b2a95a33ec3b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.038606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1e981-9ce7-4584-8965-b2a95a33ec3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.038995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1e981-9ce7-4584-8965-b2a95a33ec3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.049472 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1e981-9ce7-4584-8965-b2a95a33ec3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.052802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 979/1920] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:08 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:09.052926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1e981-9ce7-4584-8965-b2a95a33ec3b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.053894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091add73-83cb-4c30-804d-9e5b8c7ebefc admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:09.061591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 942/1921] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:09.140628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091add73-83cb-4c30-804d-9e5b8c7ebefc admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.146368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a544ff-7eea-4d98-b016-50c9e829975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.147161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a544ff-7eea-4d98-b016-50c9e829975f admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.147488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a544ff-7eea-4d98-b016-50c9e829975f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.147760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a544ff-7eea-4d98-b016-50c9e829975f admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.148458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a544ff-7eea-4d98-b016-50c9e829975f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.150429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a544ff-7eea-4d98-b016-50c9e829975f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.168338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:09.184321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 980/1922] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:09 2022] POST /identity/v3/users => generated 301 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:09.185831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1e981-9ce7-4584-8965-b2a95a33ec3b service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:09.197088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1e981-9ce7-4584-8965-b2a95a33ec3b service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.202080 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea3f3f-7a47-439b-82e4-1009883d20ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.202841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea3f3f-7a47-439b-82e4-1009883d20ab admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.203217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea3f3f-7a47-439b-82e4-1009883d20ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.203557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea3f3f-7a47-439b-82e4-1009883d20ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.204393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea3f3f-7a47-439b-82e4-1009883d20ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.206055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea3f3f-7a47-439b-82e4-1009883d20ab admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.216854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 943/1923] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:09.221635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a544ff-7eea-4d98-b016-50c9e829975f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:09.232908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a544ff-7eea-4d98-b016-50c9e829975f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.238032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fd30a-2042-41f7-93ad-8998d6532186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.238710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fd30a-2042-41f7-93ad-8998d6532186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.239039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fd30a-2042-41f7-93ad-8998d6532186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.239316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fd30a-2042-41f7-93ad-8998d6532186 admin admin] PATH_INFO: `/v3/projects/738b00a6b4664fc6baac6356fe940760/users/ab9c3674969b44e6a33e243c66957269/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.256301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fd30a-2042-41f7-93ad-8998d6532186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738b00a6b4664fc6baac6356fe940760, user_id=ab9c3674969b44e6a33e243c66957269, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.258976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fd30a-2042-41f7-93ad-8998d6532186 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.275454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 981/1924] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:09 2022] PUT /identity/v3/projects/738b00a6b4664fc6baac6356fe940760/users/ab9c3674969b44e6a33e243c66957269/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:09.279639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea3f3f-7a47-439b-82e4-1009883d20ab admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:09.290034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea3f3f-7a47-439b-82e4-1009883d20ab admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.355096 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fd30a-2042-41f7-93ad-8998d6532186 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:09.357431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d40fd30a-2042-41f7-93ad-8998d6532186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:09.359003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96847c-94e5-4ff3-85e9-9a873f1d5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.359705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96847c-94e5-4ff3-85e9-9a873f1d5a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.360087 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96847c-94e5-4ff3-85e9-9a873f1d5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.360526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96847c-94e5-4ff3-85e9-9a873f1d5a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.361250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96847c-94e5-4ff3-85e9-9a873f1d5a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.365439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96847c-94e5-4ff3-85e9-9a873f1d5a4f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.373270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fd30a-2042-41f7-93ad-8998d6532186 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.374559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 944/1925] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:09.378295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96847c-94e5-4ff3-85e9-9a873f1d5a4f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:09.379232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.379899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.380189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.380448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] PATH_INFO: `/v3/projects/07a56804063e431188d3fe9c58b7ee2e` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.381861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a56804063e431188d3fe9c58b7ee2e)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.384476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.389862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96847c-94e5-4ff3-85e9-9a873f1d5a4f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.395862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b6f68-a4f7-466a-bfb6-18812035ff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.396624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6f68-a4f7-466a-bfb6-18812035ff07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.396918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6f68-a4f7-466a-bfb6-18812035ff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.397186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6f68-a4f7-466a-bfb6-18812035ff07 admin admin] PATH_INFO: `/v3/projects/738b00a6b4664fc6baac6356fe940760/users/ab9c3674969b44e6a33e243c66957269/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.399397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b6f68-a4f7-466a-bfb6-18812035ff07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738b00a6b4664fc6baac6356fe940760, user_id=ab9c3674969b44e6a33e243c66957269, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.402438 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b6f68-a4f7-466a-bfb6-18812035ff07 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.410515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:09.416350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 945/1926] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:09 2022] PUT /identity/v3/projects/738b00a6b4664fc6baac6356fe940760/users/ab9c3674969b44e6a33e243c66957269/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:09.427373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d62c3-110a-4f0d-be47-80416e1f57e9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.428089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d62c3-110a-4f0d-be47-80416e1f57e9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.428089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d62c3-110a-4f0d-be47-80416e1f57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.443498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a56804063e431188d3fe9c58b7ee2e', 'request_id': 'req-ba67a54e-968b-4818-94b4-d26c919e700e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:09.449321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a56804063e431188d3fe9c58b7ee2e', 'request_id': 'req-ba67a54e-968b-4818-94b4-d26c919e700e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:09.456519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a56804063e431188d3fe9c58b7ee2e', 'request_id': 'req-ba67a54e-968b-4818-94b4-d26c919e700e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:09.457041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-dd4d62c3-110a-4f0d-be47-80416e1f57e9 None None] MFA Rules not processed for user `ab9c3674969b44e6a33e243c66957269`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:09.458281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dd4d62c3-110a-4f0d-be47-80416e1f57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:09.471830 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] The token cache is being invalidate because project 07a56804063e431188d3fe9c58b7ee2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:09.472116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:09.472772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:09.474529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 982/1927] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:09 2022] DELETE /identity/v3/projects/07a56804063e431188d3fe9c58b7ee2e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:09.536588 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 946/1928] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:09.549514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:09.551283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:09.635327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67a54e-968b-4818-94b4-d26c919e700e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.647615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792e0d4-d93f-4bd6-8aa6-cc55cb0cb126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.648281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792e0d4-d93f-4bd6-8aa6-cc55cb0cb126 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.648703 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792e0d4-d93f-4bd6-8aa6-cc55cb0cb126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.649891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792e0d4-d93f-4bd6-8aa6-cc55cb0cb126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.663969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792e0d4-d93f-4bd6-8aa6-cc55cb0cb126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.665380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792e0d4-d93f-4bd6-8aa6-cc55cb0cb126 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.687573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 983/1929] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:09 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:09.834528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d62c3-110a-4f0d-be47-80416e1f57e9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:09.836012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dd4d62c3-110a-4f0d-be47-80416e1f57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:09.906429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d62c3-110a-4f0d-be47-80416e1f57e9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:09.912299 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:09.912953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.913235 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.913508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] PATH_INFO: `/v3/users/270d901ab93c4972a77d02514db81aae` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.914788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=270d901ab93c4972a77d02514db81aae)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:09.916764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:09.967365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270d901ab93c4972a77d02514db81aae'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:09.975437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270d901ab93c4972a77d02514db81aae'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:09.988713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270d901ab93c4972a77d02514db81aae'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:09.999719 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270d901ab93c4972a77d02514db81aae'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.000510 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270d901ab93c4972a77d02514db81aae'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.009976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 947/1930] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:09 2022] DELETE /identity/v3/users/270d901ab93c4972a77d02514db81aae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:10.012851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d7db-205b-4962-9d20-8d120c9d44f7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:10.013443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d7db-205b-4962-9d20-8d120c9d44f7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:10.013443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d7db-205b-4962-9d20-8d120c9d44f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:10.033637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-21a6d7db-205b-4962-9d20-8d120c9d44f7 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:10.034908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-21a6d7db-205b-4962-9d20-8d120c9d44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:10.090068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:10.101248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 984/1931] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:10.111397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:10.112884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:10.119619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:10.177886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a92469-5337-41c0-8a5e-aaab2d45c45e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:10.182240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13f6b1-4cdb-44da-8b46-7e13cb286176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:10.182909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13f6b1-4cdb-44da-8b46-7e13cb286176 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:10.183193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13f6b1-4cdb-44da-8b46-7e13cb286176 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:10.183467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13f6b1-4cdb-44da-8b46-7e13cb286176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:10.193681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13f6b1-4cdb-44da-8b46-7e13cb286176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:10.195145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13f6b1-4cdb-44da-8b46-7e13cb286176 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:10.204973 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 948/1932] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:10.485736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d7db-205b-4962-9d20-8d120c9d44f7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:10.487450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-21a6d7db-205b-4962-9d20-8d120c9d44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:10.501191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d7db-205b-4962-9d20-8d120c9d44f7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:10.505991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:10.506668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:10.506981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:10.507245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] PATH_INFO: `/v3/projects/dbc3e11c85f64ce9ba6437d5a453b6fc` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:10.508389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc3e11c85f64ce9ba6437d5a453b6fc)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:10.510318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:10.559976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc3e11c85f64ce9ba6437d5a453b6fc', 'request_id': 'req-8250767e-1103-42e9-a792-77a7e8d45e44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.566032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc3e11c85f64ce9ba6437d5a453b6fc', 'request_id': 'req-8250767e-1103-42e9-a792-77a7e8d45e44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.572444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc3e11c85f64ce9ba6437d5a453b6fc', 'request_id': 'req-8250767e-1103-42e9-a792-77a7e8d45e44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.587714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] The token cache is being invalidate because project dbc3e11c85f64ce9ba6437d5a453b6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:10.588026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.588749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.590282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 985/1933] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:10 2022] DELETE /identity/v3/projects/dbc3e11c85f64ce9ba6437d5a453b6fc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:10.594406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13f6b1-4cdb-44da-8b46-7e13cb286176 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:10.604375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13f6b1-4cdb-44da-8b46-7e13cb286176 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:10.669347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:10.670017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:10.670292 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:10.670563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] PATH_INFO: `/v3/users/ab9c3674969b44e6a33e243c66957269` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:10.671741 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9c3674969b44e6a33e243c66957269)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:10.673653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:10.739669 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9c3674969b44e6a33e243c66957269'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.740649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9c3674969b44e6a33e243c66957269'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.755522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9c3674969b44e6a33e243c66957269'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.764217 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9c3674969b44e6a33e243c66957269'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.764885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-989e0b4c-2094-46d8-bca8-36874a2e38ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9c3674969b44e6a33e243c66957269'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:10.771396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 949/1934] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:10 2022] DELETE /identity/v3/users/ab9c3674969b44e6a33e243c66957269 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:11.105300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:11.106778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:11.123862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250767e-1103-42e9-a792-77a7e8d45e44 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:11.182211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:11.182905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.183187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.183465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] PATH_INFO: `/v3/projects/738b00a6b4664fc6baac6356fe940760` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.184646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738b00a6b4664fc6baac6356fe940760)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:11.186556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:11.240368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738b00a6b4664fc6baac6356fe940760', 'request_id': 'req-bbcc8c39-b091-484d-92c5-0a3e1b784146'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:11.247240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738b00a6b4664fc6baac6356fe940760', 'request_id': 'req-bbcc8c39-b091-484d-92c5-0a3e1b784146'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:11.255094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738b00a6b4664fc6baac6356fe940760', 'request_id': 'req-bbcc8c39-b091-484d-92c5-0a3e1b784146'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:11.270253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] The token cache is being invalidate because project 738b00a6b4664fc6baac6356fe940760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:11.270536 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:11.271232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbcc8c39-b091-484d-92c5-0a3e1b784146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:11.272764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 986/1935] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:11 2022] DELETE /identity/v3/projects/738b00a6b4664fc6baac6356fe940760 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:11.281310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e169f-6342-4c18-9e70-322d89d08d7d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.281310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e169f-6342-4c18-9e70-322d89d08d7d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.281310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e169f-6342-4c18-9e70-322d89d08d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.300041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f35e169f-6342-4c18-9e70-322d89d08d7d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:11.301224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f35e169f-6342-4c18-9e70-322d89d08d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:11.322115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:11.362746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 950/1936] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:11.371127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139d00e-57bf-47ab-92a3-4bc8b6477504 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.371440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139d00e-57bf-47ab-92a3-4bc8b6477504 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.371721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139d00e-57bf-47ab-92a3-4bc8b6477504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.394216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7139d00e-57bf-47ab-92a3-4bc8b6477504 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:11.395590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7139d00e-57bf-47ab-92a3-4bc8b6477504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:11.404228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 987/1937] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:11.408753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e169f-6342-4c18-9e70-322d89d08d7d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:11.418757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e169f-6342-4c18-9e70-322d89d08d7d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:11.423847 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223fcff-66ba-4f8e-8567-d86ffa06e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:11.424494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223fcff-66ba-4f8e-8567-d86ffa06e6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.424778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223fcff-66ba-4f8e-8567-d86ffa06e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.425044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223fcff-66ba-4f8e-8567-d86ffa06e6e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.425691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223fcff-66ba-4f8e-8567-d86ffa06e6e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:11.425979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223fcff-66ba-4f8e-8567-d86ffa06e6e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:11.427591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223fcff-66ba-4f8e-8567-d86ffa06e6e2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:11.439064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 951/1938] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:25:11.443296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139d00e-57bf-47ab-92a3-4bc8b6477504 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:11.449429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:11.453480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139d00e-57bf-47ab-92a3-4bc8b6477504 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:11.460203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee4c8a-06e8-42d6-9310-36a4a7a5ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:11.460829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee4c8a-06e8-42d6-9310-36a4a7a5ee8b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.461131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee4c8a-06e8-42d6-9310-36a4a7a5ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.461407 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee4c8a-06e8-42d6-9310-36a4a7a5ee8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.462056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee4c8a-06e8-42d6-9310-36a4a7a5ee8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:11.464093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee4c8a-06e8-42d6-9310-36a4a7a5ee8b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:11.496148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 988/1939] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:11 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:11.500856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223fcff-66ba-4f8e-8567-d86ffa06e6e2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:11.511173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223fcff-66ba-4f8e-8567-d86ffa06e6e2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:11.569445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357ad07-83f8-4986-8150-a816e3388cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:11.570052 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357ad07-83f8-4986-8150-a816e3388cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.570328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357ad07-83f8-4986-8150-a816e3388cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.570598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357ad07-83f8-4986-8150-a816e3388cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.571272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357ad07-83f8-4986-8150-a816e3388cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:11.573190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357ad07-83f8-4986-8150-a816e3388cd0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:11.596867 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 952/1940] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:11 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:11.603140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee4c8a-06e8-42d6-9310-36a4a7a5ee8b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:11.617484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee4c8a-06e8-42d6-9310-36a4a7a5ee8b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:11.625669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea200c-d8a4-491e-8046-da2a440e8edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:11.626412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea200c-d8a4-491e-8046-da2a440e8edc admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.626663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea200c-d8a4-491e-8046-da2a440e8edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.626976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea200c-d8a4-491e-8046-da2a440e8edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.627747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea200c-d8a4-491e-8046-da2a440e8edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:11.629397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea200c-d8a4-491e-8046-da2a440e8edc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:11.640102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 989/1941] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:11.644393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357ad07-83f8-4986-8150-a816e3388cd0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:11.654608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357ad07-83f8-4986-8150-a816e3388cd0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:11.659633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28456e5-ce4c-40dd-856c-e1f6d2fbd4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:11.660237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28456e5-ce4c-40dd-856c-e1f6d2fbd4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.660488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28456e5-ce4c-40dd-856c-e1f6d2fbd4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.660774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28456e5-ce4c-40dd-856c-e1f6d2fbd4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.661410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28456e5-ce4c-40dd-856c-e1f6d2fbd4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:11.663028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28456e5-ce4c-40dd-856c-e1f6d2fbd4f3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:11.673763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 953/1942] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:11.677989 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea200c-d8a4-491e-8046-da2a440e8edc admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:11.688638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea200c-d8a4-491e-8046-da2a440e8edc admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:11.694439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f59228-cc55-433f-8cdc-ce22599c3922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:11.695162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59228-cc55-433f-8cdc-ce22599c3922 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.695440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59228-cc55-433f-8cdc-ce22599c3922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.695713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59228-cc55-433f-8cdc-ce22599c3922 admin admin] PATH_INFO: `/v3/projects/f28bc431bc49405b8f2f138cc8191330/users/12c8c6f2058143cd90a4012f59149ed7/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.711727 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f59228-cc55-433f-8cdc-ce22599c3922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28bc431bc49405b8f2f138cc8191330, user_id=12c8c6f2058143cd90a4012f59149ed7, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:11.714410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f59228-cc55-433f-8cdc-ce22599c3922 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:11.731398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 990/1943] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:11 2022] PUT /identity/v3/projects/f28bc431bc49405b8f2f138cc8191330/users/12c8c6f2058143cd90a4012f59149ed7/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:11.741962 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfffe1f-22d7-4f17-9d7d-de4a5c625115 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.742260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfffe1f-22d7-4f17-9d7d-de4a5c625115 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.742534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfffe1f-22d7-4f17-9d7d-de4a5c625115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.773556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fbfffe1f-22d7-4f17-9d7d-de4a5c625115 None None] MFA Rules not processed for user `12c8c6f2058143cd90a4012f59149ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:11.774974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fbfffe1f-22d7-4f17-9d7d-de4a5c625115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:11.848569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 954/1944] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:21.726918 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=22,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:21.843830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:23.394261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f59228-cc55-433f-8cdc-ce22599c3922 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:23.396417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-11f59228-cc55-433f-8cdc-ce22599c3922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:23.461314 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f59228-cc55-433f-8cdc-ce22599c3922 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:23.465209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496a234-1eec-4b50-b723-95ac42498636 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ea18d542ca24e39ac758f34ad65e7bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:23.465845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496a234-1eec-4b50-b723-95ac42498636 service glance] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:23.466549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496a234-1eec-4b50-b723-95ac42498636 service glance] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:23.466549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496a234-1eec-4b50-b723-95ac42498636 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:23.475646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496a234-1eec-4b50-b723-95ac42498636 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:23.477139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496a234-1eec-4b50-b723-95ac42498636 service glance] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:23.487698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 991/1945] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:33.482233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=26 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:33.986052 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfffe1f-22d7-4f17-9d7d-de4a5c625115 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:33.987562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fbfffe1f-22d7-4f17-9d7d-de4a5c625115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:34.055288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfffe1f-22d7-4f17-9d7d-de4a5c625115 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:34.060685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:34.061362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:34.061617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:34.061889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] PATH_INFO: `/v3/users/5f7234d1597b493ea9ec9a261bd6fdd5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:34.067651 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7234d1597b493ea9ec9a261bd6fdd5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:34.069619 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:34.119275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7234d1597b493ea9ec9a261bd6fdd5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.126650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7234d1597b493ea9ec9a261bd6fdd5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.138468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7234d1597b493ea9ec9a261bd6fdd5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.146696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7234d1597b493ea9ec9a261bd6fdd5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.147328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7234d1597b493ea9ec9a261bd6fdd5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.153304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 955/1946] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:33 2022] DELETE /identity/v3/users/5f7234d1597b493ea9ec9a261bd6fdd5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:34.158029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d5a8f-9d29-4edb-a31c-7f8d6ffb9dd0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:34.158310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d5a8f-9d29-4edb-a31c-7f8d6ffb9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:34.158581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d5a8f-9d29-4edb-a31c-7f8d6ffb9dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:34.179586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9c4d5a8f-9d29-4edb-a31c-7f8d6ffb9dd0 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:34.180802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9c4d5a8f-9d29-4edb-a31c-7f8d6ffb9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:34.244297 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 992/1947] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:34.255050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:34.256518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:34.318707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64305661-934d-4512-aa4c-0cad63878941 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:34.322915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa59ae2-e273-41b4-b862-a51eb5a2e6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:34.323523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa59ae2-e273-41b4-b862-a51eb5a2e6aa service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:34.323795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa59ae2-e273-41b4-b862-a51eb5a2e6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:34.324023 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa59ae2-e273-41b4-b862-a51eb5a2e6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:34.334385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa59ae2-e273-41b4-b862-a51eb5a2e6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:34.335936 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa59ae2-e273-41b4-b862-a51eb5a2e6aa service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:34.346341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 956/1948] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:34.640913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d5a8f-9d29-4edb-a31c-7f8d6ffb9dd0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:34.642465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9c4d5a8f-9d29-4edb-a31c-7f8d6ffb9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:34.662115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d5a8f-9d29-4edb-a31c-7f8d6ffb9dd0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:34.673103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:34.673963 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:34.674232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:34.674779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] PATH_INFO: `/v3/projects/c4cbf63c6ed74c1db8299b2cbacc7e2a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:34.676070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4cbf63c6ed74c1db8299b2cbacc7e2a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:34.677979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:34.729703 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4cbf63c6ed74c1db8299b2cbacc7e2a', 'request_id': 'req-122e6ff8-d6fa-4ffd-b795-1f597924fb87'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.741067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4cbf63c6ed74c1db8299b2cbacc7e2a', 'request_id': 'req-122e6ff8-d6fa-4ffd-b795-1f597924fb87'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.747943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4cbf63c6ed74c1db8299b2cbacc7e2a', 'request_id': 'req-122e6ff8-d6fa-4ffd-b795-1f597924fb87'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.762138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] The token cache is being invalidate because project c4cbf63c6ed74c1db8299b2cbacc7e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:34.762521 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.763220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-122e6ff8-d6fa-4ffd-b795-1f597924fb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:34.764896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 993/1949] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:34 2022] DELETE /identity/v3/projects/c4cbf63c6ed74c1db8299b2cbacc7e2a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:34.769959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae42bc-a548-4715-b8e5-3778b12119da None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:34.770249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae42bc-a548-4715-b8e5-3778b12119da None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:34.770543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae42bc-a548-4715-b8e5-3778b12119da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:34.795656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d1ae42bc-a548-4715-b8e5-3778b12119da None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:34.796918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d1ae42bc-a548-4715-b8e5-3778b12119da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:34.815131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:34.874046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 957/1950] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:34.880257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640fa19-e7af-44c4-9bd3-5bab818d0d7d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:34.880586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640fa19-e7af-44c4-9bd3-5bab818d0d7d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:34.880806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640fa19-e7af-44c4-9bd3-5bab818d0d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:34.903361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0640fa19-e7af-44c4-9bd3-5bab818d0d7d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:34.904641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0640fa19-e7af-44c4-9bd3-5bab818d0d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:34.912836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 994/1951] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:34.917332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae42bc-a548-4715-b8e5-3778b12119da None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:34.927254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae42bc-a548-4715-b8e5-3778b12119da None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:34.931979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ce640-b3ed-472f-8b79-2c94f26d50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:34.932577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ce640-b3ed-472f-8b79-2c94f26d50f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:34.932859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ce640-b3ed-472f-8b79-2c94f26d50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:34.933136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ce640-b3ed-472f-8b79-2c94f26d50f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:34.933790 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ce640-b3ed-472f-8b79-2c94f26d50f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:34.934104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ce640-b3ed-472f-8b79-2c94f26d50f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:34.935768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ce640-b3ed-472f-8b79-2c94f26d50f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:34.947437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 958/1952] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:34.951864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640fa19-e7af-44c4-9bd3-5bab818d0d7d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:34.961878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640fa19-e7af-44c4-9bd3-5bab818d0d7d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:34.969714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e88f30-c09d-4741-a078-064e09dbb7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:34.969714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e88f30-c09d-4741-a078-064e09dbb7ff admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:34.969714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e88f30-c09d-4741-a078-064e09dbb7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:34.969714 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e88f30-c09d-4741-a078-064e09dbb7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:34.970157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e88f30-c09d-4741-a078-064e09dbb7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:34.971368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e88f30-c09d-4741-a078-064e09dbb7ff admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:35.011495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 995/1953] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:34 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:35.017026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ce640-b3ed-472f-8b79-2c94f26d50f6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:35.027342 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ce640-b3ed-472f-8b79-2c94f26d50f6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:35.087490 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cd87b-616c-4884-afdb-103631511bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:35.088113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cd87b-616c-4884-afdb-103631511bda admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:35.088396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cd87b-616c-4884-afdb-103631511bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:35.088673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cd87b-616c-4884-afdb-103631511bda admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:35.089347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cd87b-616c-4884-afdb-103631511bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:35.091295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cd87b-616c-4884-afdb-103631511bda admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:35.116501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 959/1954] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:35 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:35.120524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e88f30-c09d-4741-a078-064e09dbb7ff admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:35.131224 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e88f30-c09d-4741-a078-064e09dbb7ff admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:35.135935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13bd1b-ede2-4b29-80bb-bce7a75a27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:35.136585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13bd1b-ede2-4b29-80bb-bce7a75a27e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:35.136864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13bd1b-ede2-4b29-80bb-bce7a75a27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:35.137134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13bd1b-ede2-4b29-80bb-bce7a75a27e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:35.137831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13bd1b-ede2-4b29-80bb-bce7a75a27e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:35.139457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13bd1b-ede2-4b29-80bb-bce7a75a27e6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:35.152598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 996/1955] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:35.153848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cd87b-616c-4884-afdb-103631511bda admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:35.164655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cd87b-616c-4884-afdb-103631511bda admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:35.169239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee05c0-6b9f-4281-afed-265b647bdfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:35.169844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee05c0-6b9f-4281-afed-265b647bdfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:35.170161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee05c0-6b9f-4281-afed-265b647bdfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:35.170411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee05c0-6b9f-4281-afed-265b647bdfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:35.171116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee05c0-6b9f-4281-afed-265b647bdfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:35.172673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee05c0-6b9f-4281-afed-265b647bdfc3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:35.186778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 960/1956] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:35.191268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13bd1b-ede2-4b29-80bb-bce7a75a27e6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:35.202954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13bd1b-ede2-4b29-80bb-bce7a75a27e6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:35.208236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb926b-6b1a-4016-a845-c6e1b53fa688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:35.208889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb926b-6b1a-4016-a845-c6e1b53fa688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:35.209171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb926b-6b1a-4016-a845-c6e1b53fa688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:35.209491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb926b-6b1a-4016-a845-c6e1b53fa688 admin admin] PATH_INFO: `/v3/projects/8af8891f0955439fa67a00574afaae39/users/5b95adfddd2245e880f04b23cb341a57/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:35.224724 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb926b-6b1a-4016-a845-c6e1b53fa688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af8891f0955439fa67a00574afaae39, user_id=5b95adfddd2245e880f04b23cb341a57, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:35.227331 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb926b-6b1a-4016-a845-c6e1b53fa688 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:35.241276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 997/1957] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:35 2022] PUT /identity/v3/projects/8af8891f0955439fa67a00574afaae39/users/5b95adfddd2245e880f04b23cb341a57/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:35.254903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5433be-63ae-4433-9583-3be162c0855a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:35.255229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5433be-63ae-4433-9583-3be162c0855a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:35.255518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5433be-63ae-4433-9583-3be162c0855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:35.290846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5f5433be-63ae-4433-9583-3be162c0855a None None] MFA Rules not processed for user `5b95adfddd2245e880f04b23cb341a57`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:35.292081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5f5433be-63ae-4433-9583-3be162c0855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:35.371366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 961/1958] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:35.383463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb926b-6b1a-4016-a845-c6e1b53fa688 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:35.385417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-99eb926b-6b1a-4016-a845-c6e1b53fa688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:35.408491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:35.444596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb926b-6b1a-4016-a845-c6e1b53fa688 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:35.449239 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353313a-ff1c-44fe-b2c0-3c54ca7699f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:35.449859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353313a-ff1c-44fe-b2c0-3c54ca7699f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:35.450130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353313a-ff1c-44fe-b2c0-3c54ca7699f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:35.450382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353313a-ff1c-44fe-b2c0-3c54ca7699f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:35.459717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353313a-ff1c-44fe-b2c0-3c54ca7699f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:35.461138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353313a-ff1c-44fe-b2c0-3c54ca7699f8 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:35.470281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 998/1959] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:39.434955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5433be-63ae-4433-9583-3be162c0855a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:39.436603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5f5433be-63ae-4433-9583-3be162c0855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:39.460561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:39.507190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5433be-63ae-4433-9583-3be162c0855a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:39.511736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:39.512379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:39.512655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:39.512958 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] PATH_INFO: `/v3/users/5fa629fcf4394aaaa6ca3a9d9fb64e51` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:39.514011 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa629fcf4394aaaa6ca3a9d9fb64e51)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:39.515970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:39.566122 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa629fcf4394aaaa6ca3a9d9fb64e51'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:39.575410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa629fcf4394aaaa6ca3a9d9fb64e51'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:39.588632 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa629fcf4394aaaa6ca3a9d9fb64e51'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:39.597082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa629fcf4394aaaa6ca3a9d9fb64e51'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:39.597770 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa629fcf4394aaaa6ca3a9d9fb64e51'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:39.604211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 962/1960] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:39 2022] DELETE /identity/v3/users/5fa629fcf4394aaaa6ca3a9d9fb64e51 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:39.608967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287fcc-4aa7-4553-a8b0-b15cd40841e4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:39.609438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287fcc-4aa7-4553-a8b0-b15cd40841e4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:39.609532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287fcc-4aa7-4553-a8b0-b15cd40841e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:39.629600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e5287fcc-4aa7-4553-a8b0-b15cd40841e4 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:39.630860 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e5287fcc-4aa7-4553-a8b0-b15cd40841e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:39.691076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 999/1961] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:39.701163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:39.702859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:39.763435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548714d3-f113-4c69-8bec-2ce0d233c815 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:39.767408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42936a-113d-4f5c-9e9d-4981587f8648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:39.768027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42936a-113d-4f5c-9e9d-4981587f8648 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:39.768307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42936a-113d-4f5c-9e9d-4981587f8648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:39.768583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42936a-113d-4f5c-9e9d-4981587f8648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:39.777930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42936a-113d-4f5c-9e9d-4981587f8648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:39.779404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42936a-113d-4f5c-9e9d-4981587f8648 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:39.788941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 963/1962] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:40.067336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5287fcc-4aa7-4553-a8b0-b15cd40841e4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:40.068874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e5287fcc-4aa7-4553-a8b0-b15cd40841e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:40.082962 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5287fcc-4aa7-4553-a8b0-b15cd40841e4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:40.087939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:40.088591 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:40.088873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:40.089685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] PATH_INFO: `/v3/projects/13451d44792b47a38051c1c0a4394385` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:40.091071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13451d44792b47a38051c1c0a4394385)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:40.093052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:40.146819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13451d44792b47a38051c1c0a4394385', 'request_id': 'req-09e99756-d423-4fd4-a005-a198d50d2a0d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:40.152363 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13451d44792b47a38051c1c0a4394385', 'request_id': 'req-09e99756-d423-4fd4-a005-a198d50d2a0d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:40.158781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13451d44792b47a38051c1c0a4394385', 'request_id': 'req-09e99756-d423-4fd4-a005-a198d50d2a0d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:40.172705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] The token cache is being invalidate because project 13451d44792b47a38051c1c0a4394385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:40.173173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:40.174031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-09e99756-d423-4fd4-a005-a198d50d2a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:40.176059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1000/1963] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:40 2022] DELETE /identity/v3/projects/13451d44792b47a38051c1c0a4394385 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:42.414977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42936a-113d-4f5c-9e9d-4981587f8648 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:42.416653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-da42936a-113d-4f5c-9e9d-4981587f8648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:42.433964 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42936a-113d-4f5c-9e9d-4981587f8648 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:42.472381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:42.498245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:42.498965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:42.499246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:42.499518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] PATH_INFO: `/v3/users/6cdaca05726744c3b57f34f4331a4eaf` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:42.500825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cdaca05726744c3b57f34f4331a4eaf)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:42.502669 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:42.554321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cdaca05726744c3b57f34f4331a4eaf'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.562013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cdaca05726744c3b57f34f4331a4eaf'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.577125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cdaca05726744c3b57f34f4331a4eaf'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.599275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cdaca05726744c3b57f34f4331a4eaf'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.600035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cdaca05726744c3b57f34f4331a4eaf'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.609466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 964/1964] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:42 2022] DELETE /identity/v3/users/6cdaca05726744c3b57f34f4331a4eaf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:42.615144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1061e-6ce3-4cc6-ac93-f161ba180348 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:42.615595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1061e-6ce3-4cc6-ac93-f161ba180348 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:42.615706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1061e-6ce3-4cc6-ac93-f161ba180348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:42.636249 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-42b1061e-6ce3-4cc6-ac93-f161ba180348 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:42.637744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-42b1061e-6ce3-4cc6-ac93-f161ba180348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:42.693179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:42.713953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1001/1965] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:42.723992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:42.725429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:42.786026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99790e-4904-4b58-919f-cc1b9c5620c6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:42.791036 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7aa07-56a7-446c-bc52-0b25957c3709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:42.791613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7aa07-56a7-446c-bc52-0b25957c3709 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:42.791929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7aa07-56a7-446c-bc52-0b25957c3709 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:42.792194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7aa07-56a7-446c-bc52-0b25957c3709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:42.801964 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7aa07-56a7-446c-bc52-0b25957c3709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:42.803428 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7aa07-56a7-446c-bc52-0b25957c3709 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:42.813309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 965/1966] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:43.156430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1061e-6ce3-4cc6-ac93-f161ba180348 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.157912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-42b1061e-6ce3-4cc6-ac93-f161ba180348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:43.176395 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1061e-6ce3-4cc6-ac93-f161ba180348 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.181265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.181987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.182330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.182666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] PATH_INFO: `/v3/projects/1ab979e54ca040c8a1093d62164922f8` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.183876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab979e54ca040c8a1093d62164922f8)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.186006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.235780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab979e54ca040c8a1093d62164922f8', 'request_id': 'req-1615bd38-a073-4d89-9dc9-f1a8b202f39f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.241473 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab979e54ca040c8a1093d62164922f8', 'request_id': 'req-1615bd38-a073-4d89-9dc9-f1a8b202f39f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.248350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab979e54ca040c8a1093d62164922f8', 'request_id': 'req-1615bd38-a073-4d89-9dc9-f1a8b202f39f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.262471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] The token cache is being invalidate because project 1ab979e54ca040c8a1093d62164922f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:43.262752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.263417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1615bd38-a073-4d89-9dc9-f1a8b202f39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.264947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1002/1967] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:43 2022] DELETE /identity/v3/projects/1ab979e54ca040c8a1093d62164922f8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:43.270338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258568e-7bf1-46aa-aa5f-cc5ffe813168 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.270661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258568e-7bf1-46aa-aa5f-cc5ffe813168 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.270961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258568e-7bf1-46aa-aa5f-cc5ffe813168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.293712 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6258568e-7bf1-46aa-aa5f-cc5ffe813168 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:43.294873 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6258568e-7bf1-46aa-aa5f-cc5ffe813168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:43.357019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 966/1968] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:43.365141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251dd7-e657-42de-bf59-db79febac14c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.365426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251dd7-e657-42de-bf59-db79febac14c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.365695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251dd7-e657-42de-bf59-db79febac14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.389214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-37251dd7-e657-42de-bf59-db79febac14c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:43.390363 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-37251dd7-e657-42de-bf59-db79febac14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:43.399638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1003/1969] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:43.403676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258568e-7bf1-46aa-aa5f-cc5ffe813168 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.408681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:43.414354 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258568e-7bf1-46aa-aa5f-cc5ffe813168 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.420404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16b6ff-6430-4bd3-b39f-398e0d54fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.421298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16b6ff-6430-4bd3-b39f-398e0d54fdbc admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.421600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16b6ff-6430-4bd3-b39f-398e0d54fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.422032 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16b6ff-6430-4bd3-b39f-398e0d54fdbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.422636 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16b6ff-6430-4bd3-b39f-398e0d54fdbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:43.423427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16b6ff-6430-4bd3-b39f-398e0d54fdbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.425364 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16b6ff-6430-4bd3-b39f-398e0d54fdbc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.437921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 967/1970] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:43.442530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37251dd7-e657-42de-bf59-db79febac14c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.457503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37251dd7-e657-42de-bf59-db79febac14c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.463518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80b8d9-56be-4064-800a-299ce08de79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.464570 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80b8d9-56be-4064-800a-299ce08de79b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.464952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80b8d9-56be-4064-800a-299ce08de79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.465728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80b8d9-56be-4064-800a-299ce08de79b admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.466459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80b8d9-56be-4064-800a-299ce08de79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.469276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80b8d9-56be-4064-800a-299ce08de79b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.502216 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1004/1971] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:43 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:43.503540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16b6ff-6430-4bd3-b39f-398e0d54fdbc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.516212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16b6ff-6430-4bd3-b39f-398e0d54fdbc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.574937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f4369-e10a-44f3-9ed2-d3e0142e6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.575510 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f4369-e10a-44f3-9ed2-d3e0142e6787 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.575791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f4369-e10a-44f3-9ed2-d3e0142e6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.576064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f4369-e10a-44f3-9ed2-d3e0142e6787 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.576731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f4369-e10a-44f3-9ed2-d3e0142e6787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.578892 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f4369-e10a-44f3-9ed2-d3e0142e6787 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.602467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 968/1972] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:43 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:43.606935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80b8d9-56be-4064-800a-299ce08de79b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.617325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80b8d9-56be-4064-800a-299ce08de79b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.622745 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086a3ec-4f3d-4e00-b98e-6c55cc444045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.623386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a3ec-4f3d-4e00-b98e-6c55cc444045 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.623666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a3ec-4f3d-4e00-b98e-6c55cc444045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.623936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a3ec-4f3d-4e00-b98e-6c55cc444045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.624580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086a3ec-4f3d-4e00-b98e-6c55cc444045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.626184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086a3ec-4f3d-4e00-b98e-6c55cc444045 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.636530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1005/1973] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:43.640519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f4369-e10a-44f3-9ed2-d3e0142e6787 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.650678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f4369-e10a-44f3-9ed2-d3e0142e6787 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.655545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33582b-4576-4579-827b-20691637d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.656140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33582b-4576-4579-827b-20691637d161 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.656408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33582b-4576-4579-827b-20691637d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.656691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33582b-4576-4579-827b-20691637d161 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.657384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33582b-4576-4579-827b-20691637d161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.658979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33582b-4576-4579-827b-20691637d161 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.669953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 969/1974] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:25:43.674304 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086a3ec-4f3d-4e00-b98e-6c55cc444045 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.686141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086a3ec-4f3d-4e00-b98e-6c55cc444045 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.692773 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad736554-419f-4f2f-a56b-d3f06c9a950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.693596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad736554-419f-4f2f-a56b-d3f06c9a950d admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.693891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad736554-419f-4f2f-a56b-d3f06c9a950d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.694217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad736554-419f-4f2f-a56b-d3f06c9a950d admin admin] PATH_INFO: `/v3/projects/9e73ffbb2c964e73ae59f6894368cea5/users/a309bd717aad47d4acb7f66fd6b33b9f/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.710069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad736554-419f-4f2f-a56b-d3f06c9a950d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e73ffbb2c964e73ae59f6894368cea5, user_id=a309bd717aad47d4acb7f66fd6b33b9f, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.712942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad736554-419f-4f2f-a56b-d3f06c9a950d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.728365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1006/1975] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:43 2022] PUT /identity/v3/projects/9e73ffbb2c964e73ae59f6894368cea5/users/a309bd717aad47d4acb7f66fd6b33b9f/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:43.740794 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851890-896c-4c92-b308-801834e90420 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.741043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851890-896c-4c92-b308-801834e90420 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.741348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851890-896c-4c92-b308-801834e90420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.770159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d2851890-896c-4c92-b308-801834e90420 None None] MFA Rules not processed for user `a309bd717aad47d4acb7f66fd6b33b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:43.771409 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2851890-896c-4c92-b308-801834e90420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:43.851788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 970/1976] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:43.859452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad736554-419f-4f2f-a56b-d3f06c9a950d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.861299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ad736554-419f-4f2f-a56b-d3f06c9a950d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:43.919894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad736554-419f-4f2f-a56b-d3f06c9a950d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.923497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa7cfe-0613-4ad7-9b42-75ac959a3ae0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.924107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa7cfe-0613-4ad7-9b42-75ac959a3ae0 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.924383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa7cfe-0613-4ad7-9b42-75ac959a3ae0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.924655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa7cfe-0613-4ad7-9b42-75ac959a3ae0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.932944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa7cfe-0613-4ad7-9b42-75ac959a3ae0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.934376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa7cfe-0613-4ad7-9b42-75ac959a3ae0 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.943313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1007/1977] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:43.968483 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851890-896c-4c92-b308-801834e90420 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.039370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:44.044162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851890-896c-4c92-b308-801834e90420 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.050623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.051329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.051606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.051885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] PATH_INFO: `/v3/users/a309bd717aad47d4acb7f66fd6b33b9f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.053088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a309bd717aad47d4acb7f66fd6b33b9f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.055877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.106575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a309bd717aad47d4acb7f66fd6b33b9f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.114236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a309bd717aad47d4acb7f66fd6b33b9f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.132304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a309bd717aad47d4acb7f66fd6b33b9f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.160433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a309bd717aad47d4acb7f66fd6b33b9f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.161089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a309bd717aad47d4acb7f66fd6b33b9f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.168931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 971/1978] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:43 2022] DELETE /identity/v3/users/a309bd717aad47d4acb7f66fd6b33b9f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:44.173467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73145-9507-41db-bd55-4de0b0ff36a6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.173758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73145-9507-41db-bd55-4de0b0ff36a6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.174036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73145-9507-41db-bd55-4de0b0ff36a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.198798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4bb73145-9507-41db-bd55-4de0b0ff36a6 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:44.198798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4bb73145-9507-41db-bd55-4de0b0ff36a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:44.201192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:44.260544 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1008/1979] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:44.270264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.271654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:44.331175 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628008c-285b-4ae3-a9fc-ccde2bc79a95 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.335642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52667a-6647-4a7f-8e01-f7c26c8e9591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.336263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52667a-6647-4a7f-8e01-f7c26c8e9591 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.336542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52667a-6647-4a7f-8e01-f7c26c8e9591 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.336814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52667a-6647-4a7f-8e01-f7c26c8e9591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.346655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52667a-6647-4a7f-8e01-f7c26c8e9591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.348163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52667a-6647-4a7f-8e01-f7c26c8e9591 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.358056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 972/1980] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:44.667973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb73145-9507-41db-bd55-4de0b0ff36a6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.670332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4bb73145-9507-41db-bd55-4de0b0ff36a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:44.687060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb73145-9507-41db-bd55-4de0b0ff36a6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.691741 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.692397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.692675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.692992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] PATH_INFO: `/v3/projects/9e73ffbb2c964e73ae59f6894368cea5` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.694076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e73ffbb2c964e73ae59f6894368cea5)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.696068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.753540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e73ffbb2c964e73ae59f6894368cea5', 'request_id': 'req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.760657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e73ffbb2c964e73ae59f6894368cea5', 'request_id': 'req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.767479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e73ffbb2c964e73ae59f6894368cea5', 'request_id': 'req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.781079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] The token cache is being invalidate because project 9e73ffbb2c964e73ae59f6894368cea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:44.781574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.782915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-8d21d9b1-1f09-4b91-b700-c30119fa2ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:44.784431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1009/1981] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:44 2022] DELETE /identity/v3/projects/9e73ffbb2c964e73ae59f6894368cea5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:45.716615 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52667a-6647-4a7f-8e01-f7c26c8e9591 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:45.718085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4c52667a-6647-4a7f-8e01-f7c26c8e9591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:45.731816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52667a-6647-4a7f-8e01-f7c26c8e9591 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:45.794920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:45.795586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:45.795872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:45.796149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] PATH_INFO: `/v3/users/5b95adfddd2245e880f04b23cb341a57` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:45.797433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b95adfddd2245e880f04b23cb341a57)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:45.800011 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:45.824607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:45.857879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b95adfddd2245e880f04b23cb341a57'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:45.867639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b95adfddd2245e880f04b23cb341a57'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:45.881789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b95adfddd2245e880f04b23cb341a57'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:45.890572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b95adfddd2245e880f04b23cb341a57'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:45.891226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b95adfddd2245e880f04b23cb341a57'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:45.901422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 973/1982] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:45 2022] DELETE /identity/v3/users/5b95adfddd2245e880f04b23cb341a57 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:45.903115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832830b5-e0dc-4f6c-9a36-5191895a5759 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:45.903568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832830b5-e0dc-4f6c-9a36-5191895a5759 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:45.903680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832830b5-e0dc-4f6c-9a36-5191895a5759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:45.923336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-832830b5-e0dc-4f6c-9a36-5191895a5759 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:45.924547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-832830b5-e0dc-4f6c-9a36-5191895a5759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:46.004011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1010/1983] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:46.013527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:46.014976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:46.074412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7305b0-6d6f-41c0-b36a-d97192763743 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:46.078367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9700636-d7e3-4a3a-84d7-ff70000f691f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:46.079030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9700636-d7e3-4a3a-84d7-ff70000f691f service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.079303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9700636-d7e3-4a3a-84d7-ff70000f691f service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.079571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9700636-d7e3-4a3a-84d7-ff70000f691f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.088625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9700636-d7e3-4a3a-84d7-ff70000f691f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:46.090040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9700636-d7e3-4a3a-84d7-ff70000f691f service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:46.099371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 974/1984] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:46.370742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832830b5-e0dc-4f6c-9a36-5191895a5759 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:46.370742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-832830b5-e0dc-4f6c-9a36-5191895a5759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:46.396080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832830b5-e0dc-4f6c-9a36-5191895a5759 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:46.401894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:46.402759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.403291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.403453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] PATH_INFO: `/v3/projects/8af8891f0955439fa67a00574afaae39` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.404655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af8891f0955439fa67a00574afaae39)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:46.406606 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:46.453780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:46.475115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af8891f0955439fa67a00574afaae39', 'request_id': 'req-2c937131-f39f-44b6-840d-1723eb656d77'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:46.481471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af8891f0955439fa67a00574afaae39', 'request_id': 'req-2c937131-f39f-44b6-840d-1723eb656d77'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:46.489167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af8891f0955439fa67a00574afaae39', 'request_id': 'req-2c937131-f39f-44b6-840d-1723eb656d77'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:46.504021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] The token cache is being invalidate because project 8af8891f0955439fa67a00574afaae39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:46.504493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:46.505357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2c937131-f39f-44b6-840d-1723eb656d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:46.507053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1011/1985] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:46 2022] DELETE /identity/v3/projects/8af8891f0955439fa67a00574afaae39 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:46.512605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea70f8-63d5-4553-87d1-21295e95c163 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.512852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea70f8-63d5-4553-87d1-21295e95c163 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.513383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea70f8-63d5-4553-87d1-21295e95c163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.550810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7dea70f8-63d5-4553-87d1-21295e95c163 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:46.550810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7dea70f8-63d5-4553-87d1-21295e95c163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:46.620323 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 975/1986] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:46.624697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38166901-cf31-4a12-988d-208edbe30a30 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.625816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38166901-cf31-4a12-988d-208edbe30a30 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.626134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38166901-cf31-4a12-988d-208edbe30a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.661718 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-38166901-cf31-4a12-988d-208edbe30a30 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:46.662967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-38166901-cf31-4a12-988d-208edbe30a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:46.671927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1012/1987] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:46.676563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea70f8-63d5-4553-87d1-21295e95c163 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:46.692178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea70f8-63d5-4553-87d1-21295e95c163 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:46.699485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf036b3-9771-4136-ab27-48eec18c2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:46.700114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf036b3-9771-4136-ab27-48eec18c2f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.700389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf036b3-9771-4136-ab27-48eec18c2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.700665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf036b3-9771-4136-ab27-48eec18c2f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.701359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf036b3-9771-4136-ab27-48eec18c2f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:46.701649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf036b3-9771-4136-ab27-48eec18c2f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:46.709183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf036b3-9771-4136-ab27-48eec18c2f4e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:46.719084 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 976/1988] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:46.723408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38166901-cf31-4a12-988d-208edbe30a30 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:46.734578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38166901-cf31-4a12-988d-208edbe30a30 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:46.739255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90021c-9f33-428a-a5ae-dcf9326db94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:46.740061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90021c-9f33-428a-a5ae-dcf9326db94e admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.740525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90021c-9f33-428a-a5ae-dcf9326db94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.740873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90021c-9f33-428a-a5ae-dcf9326db94e admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.741585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90021c-9f33-428a-a5ae-dcf9326db94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:46.743744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90021c-9f33-428a-a5ae-dcf9326db94e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:46.795818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1013/1989] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:46 2022] POST /identity/v3/projects => generated 397 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:46.797761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf036b3-9771-4136-ab27-48eec18c2f4e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:46.809000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf036b3-9771-4136-ab27-48eec18c2f4e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:46.844237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:46.879786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b19a58-3131-4d7a-9935-4b42f26696e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:46.880404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b19a58-3131-4d7a-9935-4b42f26696e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.880684 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b19a58-3131-4d7a-9935-4b42f26696e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.880949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b19a58-3131-4d7a-9935-4b42f26696e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.881711 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b19a58-3131-4d7a-9935-4b42f26696e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:46.883706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b19a58-3131-4d7a-9935-4b42f26696e9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:46.906298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 977/1990] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:46 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:46.910336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90021c-9f33-428a-a5ae-dcf9326db94e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:46.921234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90021c-9f33-428a-a5ae-dcf9326db94e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:46.926401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26027f93-fc59-45b1-968c-a4229947421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:46.927071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26027f93-fc59-45b1-968c-a4229947421c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.927354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26027f93-fc59-45b1-968c-a4229947421c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.927626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26027f93-fc59-45b1-968c-a4229947421c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.928288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26027f93-fc59-45b1-968c-a4229947421c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:46.930576 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26027f93-fc59-45b1-968c-a4229947421c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:46.948989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b19a58-3131-4d7a-9935-4b42f26696e9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:46.949238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1014/1991] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:46.959734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b19a58-3131-4d7a-9935-4b42f26696e9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:46.964397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b77f53-e823-45a8-8cb3-b1a28de43f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:46.965003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77f53-e823-45a8-8cb3-b1a28de43f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.965278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77f53-e823-45a8-8cb3-b1a28de43f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.965543 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b77f53-e823-45a8-8cb3-b1a28de43f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.966215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b77f53-e823-45a8-8cb3-b1a28de43f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:46.967849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b77f53-e823-45a8-8cb3-b1a28de43f8d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:46.978706 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 978/1992] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:46.984420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26027f93-fc59-45b1-968c-a4229947421c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:46.995710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26027f93-fc59-45b1-968c-a4229947421c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:47.001432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6796df-d870-4a23-9343-6501d41712ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:47.002112 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6796df-d870-4a23-9343-6501d41712ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:47.002398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6796df-d870-4a23-9343-6501d41712ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:47.002826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6796df-d870-4a23-9343-6501d41712ac admin admin] PATH_INFO: `/v3/projects/78cf94a9a43e40278c9cc03646dcfd62/users/55271ff34bf349c0a14597dabfbc5772/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:47.020685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6796df-d870-4a23-9343-6501d41712ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cf94a9a43e40278c9cc03646dcfd62, user_id=55271ff34bf349c0a14597dabfbc5772, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:47.023438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6796df-d870-4a23-9343-6501d41712ac admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:47.040664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1015/1993] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:46 2022] PUT /identity/v3/projects/78cf94a9a43e40278c9cc03646dcfd62/users/55271ff34bf349c0a14597dabfbc5772/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:47.052443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd89194-d4e3-4a15-b586-939d20810beb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:47.052824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd89194-d4e3-4a15-b586-939d20810beb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:47.053188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd89194-d4e3-4a15-b586-939d20810beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:47.082493 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3bd89194-d4e3-4a15-b586-939d20810beb None None] MFA Rules not processed for user `55271ff34bf349c0a14597dabfbc5772`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:47.083795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3bd89194-d4e3-4a15-b586-939d20810beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:47.158768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 979/1994] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:47.173716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6796df-d870-4a23-9343-6501d41712ac admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:47.175764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6b6796df-d870-4a23-9343-6501d41712ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:47.233934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6796df-d870-4a23-9343-6501d41712ac admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:47.238140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4afd30-27f4-48c2-bb40-3e1ae56457ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:47.238708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4afd30-27f4-48c2-bb40-3e1ae56457ae service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:47.239014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4afd30-27f4-48c2-bb40-3e1ae56457ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:47.239290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4afd30-27f4-48c2-bb40-3e1ae56457ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:47.248903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4afd30-27f4-48c2-bb40-3e1ae56457ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:47.250343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4afd30-27f4-48c2-bb40-3e1ae56457ae service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:47.259931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1016/1995] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:52.312592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd89194-d4e3-4a15-b586-939d20810beb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:52.382260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd89194-d4e3-4a15-b586-939d20810beb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:52.387211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:52.387880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:52.388154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:52.388430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] PATH_INFO: `/v3/users/55271ff34bf349c0a14597dabfbc5772` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:52.389814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55271ff34bf349c0a14597dabfbc5772)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:52.391764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:52.436872 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:52.443778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55271ff34bf349c0a14597dabfbc5772'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:52.453431 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55271ff34bf349c0a14597dabfbc5772'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:52.466751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55271ff34bf349c0a14597dabfbc5772'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:52.475998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55271ff34bf349c0a14597dabfbc5772'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:52.476728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55271ff34bf349c0a14597dabfbc5772'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:52.483383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 980/1996] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:52 2022] DELETE /identity/v3/users/55271ff34bf349c0a14597dabfbc5772 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:52.488403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579adb92-80ae-49c8-98f1-26f9faf50fc9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:52.488913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579adb92-80ae-49c8-98f1-26f9faf50fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:52.489146 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579adb92-80ae-49c8-98f1-26f9faf50fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:52.509726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-579adb92-80ae-49c8-98f1-26f9faf50fc9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:52.511300 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-579adb92-80ae-49c8-98f1-26f9faf50fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:52.567806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:52.584657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1017/1997] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:52.595350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:52.597036 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:52.662981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499feab-7be5-4074-a0e7-453a103b3aa4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:52.667139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efaf55-04c5-452b-aac4-0aaf65dcf205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:52.667788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efaf55-04c5-452b-aac4-0aaf65dcf205 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:52.668071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efaf55-04c5-452b-aac4-0aaf65dcf205 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:52.669126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efaf55-04c5-452b-aac4-0aaf65dcf205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:52.679294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efaf55-04c5-452b-aac4-0aaf65dcf205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:52.680749 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efaf55-04c5-452b-aac4-0aaf65dcf205 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:52.691920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 981/1998] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:53.026336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579adb92-80ae-49c8-98f1-26f9faf50fc9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:53.028070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-579adb92-80ae-49c8-98f1-26f9faf50fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:53.040271 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579adb92-80ae-49c8-98f1-26f9faf50fc9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:53.045601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:53.046307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:53.046677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:53.047165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] PATH_INFO: `/v3/users/12c8c6f2058143cd90a4012f59149ed7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:53.048468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c8c6f2058143cd90a4012f59149ed7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:53.050748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:53.108776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c8c6f2058143cd90a4012f59149ed7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.118887 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c8c6f2058143cd90a4012f59149ed7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.132595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c8c6f2058143cd90a4012f59149ed7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.133560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c8c6f2058143cd90a4012f59149ed7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.149371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c8c6f2058143cd90a4012f59149ed7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.157018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1018/1999] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:25:53 2022] DELETE /identity/v3/users/12c8c6f2058143cd90a4012f59149ed7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:53.162536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39241be5-c980-4237-ab9a-c270c74cd317 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:53.162910 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39241be5-c980-4237-ab9a-c270c74cd317 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:53.163773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39241be5-c980-4237-ab9a-c270c74cd317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:53.177571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:53.180531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:53.186297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-39241be5-c980-4237-ab9a-c270c74cd317 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:53.187762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-39241be5-c980-4237-ab9a-c270c74cd317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:53.272963 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11d2b5-3b2d-4269-a6ee-6cfb31f0df10 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:53.278824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:53.279550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:53.280190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:53.280533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] PATH_INFO: `/v3/projects/78cf94a9a43e40278c9cc03646dcfd62` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:53.281838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78cf94a9a43e40278c9cc03646dcfd62)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:53.283792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:53.309667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 982/2000] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:53.332277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39241be5-c980-4237-ab9a-c270c74cd317 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:53.335795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-39241be5-c980-4237-ab9a-c270c74cd317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:53.361206 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cf94a9a43e40278c9cc03646dcfd62', 'request_id': 'req-b5101acd-f189-40c6-bb48-8206ae84fdf0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.366994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cf94a9a43e40278c9cc03646dcfd62', 'request_id': 'req-b5101acd-f189-40c6-bb48-8206ae84fdf0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.374535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cf94a9a43e40278c9cc03646dcfd62', 'request_id': 'req-b5101acd-f189-40c6-bb48-8206ae84fdf0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.399675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:53.408474 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] The token cache is being invalidate because project 78cf94a9a43e40278c9cc03646dcfd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:53.409465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.411056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b5101acd-f189-40c6-bb48-8206ae84fdf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:53.423479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1019/2001] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:53 2022] DELETE /identity/v3/projects/78cf94a9a43e40278c9cc03646dcfd62 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:53.438248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39241be5-c980-4237-ab9a-c270c74cd317 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:53.460083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:53.509308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:53.510153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:53.510522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:53.510926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:53.513580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:53.598166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:53.599865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:53.611665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 983/2002] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:53.892324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1da845-61fe-4a30-b772-ce63b72f6e6d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:53.892873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1da845-61fe-4a30-b772-ce63b72f6e6d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:53.892873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1da845-61fe-4a30-b772-ce63b72f6e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:53.913348 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cc1da845-61fe-4a30-b772-ce63b72f6e6d None None] MFA Rules not processed for user `2e9eb6b2ff274a8e810c3785a295e741`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:53.914762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cc1da845-61fe-4a30-b772-ce63b72f6e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:53.965356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:53.967176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:53.976500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1020/2003] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:53.980538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0451bc1-7b58-4b6c-8253-d1383b54a0ca service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:53.985775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:53.986128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:53.986467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:53.986766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] PATH_INFO: `/v3/projects/f28bc431bc49405b8f2f138cc8191330` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:53.998131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28bc431bc49405b8f2f138cc8191330)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.004171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.076837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28bc431bc49405b8f2f138cc8191330', 'request_id': 'req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:54.086705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28bc431bc49405b8f2f138cc8191330', 'request_id': 'req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:54.092944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28bc431bc49405b8f2f138cc8191330', 'request_id': 'req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:54.105090 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] The token cache is being invalidate because project f28bc431bc49405b8f2f138cc8191330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:54.105384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:54.106043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c128f6c-d85b-42eb-9f30-80e542cf8cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:54.107586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 984/2004] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:25:53 2022] DELETE /identity/v3/projects/f28bc431bc49405b8f2f138cc8191330 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:54.112515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a82fb-43ba-48b5-a3b7-503228812ad5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.112807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a82fb-43ba-48b5-a3b7-503228812ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.113084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a82fb-43ba-48b5-a3b7-503228812ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.133309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f34a82fb-43ba-48b5-a3b7-503228812ad5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:54.134531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f34a82fb-43ba-48b5-a3b7-503228812ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:54.198135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1021/2005] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:54.208960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b24ed-353e-4807-8dc7-f64d98fb2c2f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.208960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b24ed-353e-4807-8dc7-f64d98fb2c2f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.209166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b24ed-353e-4807-8dc7-f64d98fb2c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.230742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b90b24ed-353e-4807-8dc7-f64d98fb2c2f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:54.233417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b90b24ed-353e-4807-8dc7-f64d98fb2c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:54.240374 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 985/2006] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:54.244957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a82fb-43ba-48b5-a3b7-503228812ad5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.256313 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a82fb-43ba-48b5-a3b7-503228812ad5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.261695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d48297-fd77-4995-bd42-051ddb668952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.262326 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d48297-fd77-4995-bd42-051ddb668952 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.262610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d48297-fd77-4995-bd42-051ddb668952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.262920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d48297-fd77-4995-bd42-051ddb668952 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.263587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d48297-fd77-4995-bd42-051ddb668952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:54.263921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d48297-fd77-4995-bd42-051ddb668952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.265539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d48297-fd77-4995-bd42-051ddb668952 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.277863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1022/2007] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:54.282166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b24ed-353e-4807-8dc7-f64d98fb2c2f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.292285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b24ed-353e-4807-8dc7-f64d98fb2c2f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.297492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d553c80-1bc2-4952-9d22-f12b14020d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.298110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d553c80-1bc2-4952-9d22-f12b14020d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.298381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d553c80-1bc2-4952-9d22-f12b14020d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.298654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d553c80-1bc2-4952-9d22-f12b14020d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.299376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d553c80-1bc2-4952-9d22-f12b14020d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.301277 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d553c80-1bc2-4952-9d22-f12b14020d7b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.329676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 986/2008] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:25:54 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:54.333960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d48297-fd77-4995-bd42-051ddb668952 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.346338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d48297-fd77-4995-bd42-051ddb668952 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.410277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea967-12f0-45dc-877d-e6e1fc3d00d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.410942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea967-12f0-45dc-877d-e6e1fc3d00d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.411226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea967-12f0-45dc-877d-e6e1fc3d00d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.411500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea967-12f0-45dc-877d-e6e1fc3d00d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.412161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ea967-12f0-45dc-877d-e6e1fc3d00d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.414135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ea967-12f0-45dc-877d-e6e1fc3d00d2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.436961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1023/2009] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:25:54 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:54.441125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d553c80-1bc2-4952-9d22-f12b14020d7b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.451560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d553c80-1bc2-4952-9d22-f12b14020d7b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.456112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6743-807e-44a7-b5f5-b9fa2f11219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.456720 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6743-807e-44a7-b5f5-b9fa2f11219e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.456996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6743-807e-44a7-b5f5-b9fa2f11219e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.457263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6743-807e-44a7-b5f5-b9fa2f11219e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.457906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca6743-807e-44a7-b5f5-b9fa2f11219e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.459589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca6743-807e-44a7-b5f5-b9fa2f11219e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.471320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 987/2010] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:25:54.475536 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea967-12f0-45dc-877d-e6e1fc3d00d2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.486058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea967-12f0-45dc-877d-e6e1fc3d00d2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.491821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23acf-719d-4f8d-9f2d-9d1daa1204cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.492649 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23acf-719d-4f8d-9f2d-9d1daa1204cd admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.493072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23acf-719d-4f8d-9f2d-9d1daa1204cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.493354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23acf-719d-4f8d-9f2d-9d1daa1204cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.494017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23acf-719d-4f8d-9f2d-9d1daa1204cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.495776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23acf-719d-4f8d-9f2d-9d1daa1204cd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.508557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1024/2011] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:54.512700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6743-807e-44a7-b5f5-b9fa2f11219e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.523393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6743-807e-44a7-b5f5-b9fa2f11219e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.528450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2657-98b8-4130-b2e3-f7f2cc8650fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.529484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2657-98b8-4130-b2e3-f7f2cc8650fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.530211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2657-98b8-4130-b2e3-f7f2cc8650fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.530500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2657-98b8-4130-b2e3-f7f2cc8650fc admin admin] PATH_INFO: `/v3/projects/b49af8386f8a4cdba88daf0f197e5c7f/users/98fe00c0e7d447dbaeeb6d48f475345d/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.535072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:54.549814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2657-98b8-4130-b2e3-f7f2cc8650fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49af8386f8a4cdba88daf0f197e5c7f, user_id=98fe00c0e7d447dbaeeb6d48f475345d, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.552772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2657-98b8-4130-b2e3-f7f2cc8650fc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.568622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 988/2012] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:25:54 2022] PUT /identity/v3/projects/b49af8386f8a4cdba88daf0f197e5c7f/users/98fe00c0e7d447dbaeeb6d48f475345d/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:54.580495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbde7c-e5ab-471a-90c0-958c2330ed31 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.580831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbde7c-e5ab-471a-90c0-958c2330ed31 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.581212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbde7c-e5ab-471a-90c0-958c2330ed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.602765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:54.613176 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-96fbde7c-e5ab-471a-90c0-958c2330ed31 None None] MFA Rules not processed for user `98fe00c0e7d447dbaeeb6d48f475345d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:54.614590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-96fbde7c-e5ab-471a-90c0-958c2330ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:54.683214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1025/2013] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:54.694066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2657-98b8-4130-b2e3-f7f2cc8650fc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.695917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0fcb2657-98b8-4130-b2e3-f7f2cc8650fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:54.759573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2657-98b8-4130-b2e3-f7f2cc8650fc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.771153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac4e9a-096f-4fc3-8c9c-a7bbba389b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.771866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4e9a-096f-4fc3-8c9c-a7bbba389b0c service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.772137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4e9a-096f-4fc3-8c9c-a7bbba389b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.772413 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4e9a-096f-4fc3-8c9c-a7bbba389b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.783467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4e9a-096f-4fc3-8c9c-a7bbba389b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.785105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4e9a-096f-4fc3-8c9c-a7bbba389b0c service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.798341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 989/2014] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:25:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:26:00.314422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbde7c-e5ab-471a-90c0-958c2330ed31 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:00.383337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbde7c-e5ab-471a-90c0-958c2330ed31 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:00.389394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:00.390032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:00.390316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:00.390585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] PATH_INFO: `/v3/users/98fe00c0e7d447dbaeeb6d48f475345d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:00.391974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98fe00c0e7d447dbaeeb6d48f475345d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:00.393905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:00.443316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98fe00c0e7d447dbaeeb6d48f475345d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:00.451669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98fe00c0e7d447dbaeeb6d48f475345d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:00.460421 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98fe00c0e7d447dbaeeb6d48f475345d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:00.461095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98fe00c0e7d447dbaeeb6d48f475345d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:00.474520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98fe00c0e7d447dbaeeb6d48f475345d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:00.482766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1026/2015] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:26:00 2022] DELETE /identity/v3/users/98fe00c0e7d447dbaeeb6d48f475345d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:00.485471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172afc2-1909-4911-8bba-3811ec51a431 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:00.486156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172afc2-1909-4911-8bba-3811ec51a431 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:00.486156 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172afc2-1909-4911-8bba-3811ec51a431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:00.507489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2172afc2-1909-4911-8bba-3811ec51a431 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:00.508709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2172afc2-1909-4911-8bba-3811ec51a431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:00.572708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 990/2016] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:00.582901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:00.584332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:00.607337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:00.651210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ec3d-d312-4b19-9d0a-b86a5b3e2847 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:00.655448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1510124-1705-4ea3-9bad-26b091273a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:00.656076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1510124-1705-4ea3-9bad-26b091273a32 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:00.656355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1510124-1705-4ea3-9bad-26b091273a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:00.656633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1510124-1705-4ea3-9bad-26b091273a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:00.670744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1510124-1705-4ea3-9bad-26b091273a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:00.672696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1510124-1705-4ea3-9bad-26b091273a32 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:00.695622 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1027/2017] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:01.351352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172afc2-1909-4911-8bba-3811ec51a431 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:01.353558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2172afc2-1909-4911-8bba-3811ec51a431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:01.368419 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172afc2-1909-4911-8bba-3811ec51a431 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:01.373703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:01.374364 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:01.374653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:01.374959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] PATH_INFO: `/v3/projects/b49af8386f8a4cdba88daf0f197e5c7f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:01.376113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49af8386f8a4cdba88daf0f197e5c7f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:01.378316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:01.431739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49af8386f8a4cdba88daf0f197e5c7f', 'request_id': 'req-a82b018a-51d1-46ec-be53-a06abb88d892'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:01.449987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49af8386f8a4cdba88daf0f197e5c7f', 'request_id': 'req-a82b018a-51d1-46ec-be53-a06abb88d892'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:01.456802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49af8386f8a4cdba88daf0f197e5c7f', 'request_id': 'req-a82b018a-51d1-46ec-be53-a06abb88d892'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:01.468721 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] The token cache is being invalidate because project b49af8386f8a4cdba88daf0f197e5c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:01.469116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:01.469982 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:01.471589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 991/2018] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:26:01 2022] DELETE /identity/v3/projects/b49af8386f8a4cdba88daf0f197e5c7f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:03.938940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769b05-2eaa-4849-9151-069f34719102 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:03.939486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769b05-2eaa-4849-9151-069f34719102 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:03.939753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769b05-2eaa-4849-9151-069f34719102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:03.960457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-58769b05-2eaa-4849-9151-069f34719102 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:03.961815 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-58769b05-2eaa-4849-9151-069f34719102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:04.022599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1028/2019] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:04.068132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:04.069607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:04.084599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:04.142551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b018a-51d1-46ec-be53-a06abb88d892 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:04.148021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7315c3-7e74-42d1-98d4-153ce87e6492 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:04.148646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7315c3-7e74-42d1-98d4-153ce87e6492 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:04.148928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7315c3-7e74-42d1-98d4-153ce87e6492 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:04.149245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7315c3-7e74-42d1-98d4-153ce87e6492 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:04.158280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7315c3-7e74-42d1-98d4-153ce87e6492 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:04.159883 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7315c3-7e74-42d1-98d4-153ce87e6492 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:04.168556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 992/2020] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:26:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:14.013913 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=43 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:14.165117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=27 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:18.649122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398061-094c-42a9-9363-2b831dc52fa2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:18.649678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398061-094c-42a9-9363-2b831dc52fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:18.649678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8398061-094c-42a9-9363-2b831dc52fa2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:18.651270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1029/2021] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:18.658135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30093372-b604-4a1a-8a7f-5da6380fe347 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:18.658603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30093372-b604-4a1a-8a7f-5da6380fe347 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:18.658701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30093372-b604-4a1a-8a7f-5da6380fe347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:18.679534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-30093372-b604-4a1a-8a7f-5da6380fe347 None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:18.680776 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-30093372-b604-4a1a-8a7f-5da6380fe347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:18.751301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 993/2022] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:18.763717 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8398061-094c-42a9-9363-2b831dc52fa2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:18.765367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b8398061-094c-42a9-9363-2b831dc52fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:18.828010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8398061-094c-42a9-9363-2b831dc52fa2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:18.832645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ddb4b-9a48-4cf2-8dd5-d38e4a8f0a5b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ea18d542ca24e39ac758f34ad65e7bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:18.833266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ddb4b-9a48-4cf2-8dd5-d38e4a8f0a5b service glance] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:18.833573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ddb4b-9a48-4cf2-8dd5-d38e4a8f0a5b service glance] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:18.833841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ddb4b-9a48-4cf2-8dd5-d38e4a8f0a5b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:18.844724 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ddb4b-9a48-4cf2-8dd5-d38e4a8f0a5b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:18.846158 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ddb4b-9a48-4cf2-8dd5-d38e4a8f0a5b service glance] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:18.856952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1030/2023] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:18.938099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc8eb-70f4-450d-8e85-c11500f3658f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:18.938413 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc8eb-70f4-450d-8e85-c11500f3658f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:18.938688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc8eb-70f4-450d-8e85-c11500f3658f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:18.940974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 994/2024] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:18.946073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276928e5-f1f8-4768-aa44-dd18bb30d67d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:18.946386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276928e5-f1f8-4768-aa44-dd18bb30d67d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:18.946659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276928e5-f1f8-4768-aa44-dd18bb30d67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:18.967045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-276928e5-f1f8-4768-aa44-dd18bb30d67d None None] MFA Rules not processed for user `6ae71e9e597240ee88c6bd0754244aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:18.968254 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-276928e5-f1f8-4768-aa44-dd18bb30d67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:19.021074 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1031/2025] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:19.033373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fc8eb-70f4-450d-8e85-c11500f3658f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:19.035300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-669fc8eb-70f4-450d-8e85-c11500f3658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:19.048923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fc8eb-70f4-450d-8e85-c11500f3658f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:19.052722 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696bddf-9a52-44dc-8a88-ee3e5dbf33c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:19.053321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696bddf-9a52-44dc-8a88-ee3e5dbf33c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:19.053595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696bddf-9a52-44dc-8a88-ee3e5dbf33c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:19.053865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696bddf-9a52-44dc-8a88-ee3e5dbf33c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:19.061038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696bddf-9a52-44dc-8a88-ee3e5dbf33c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:19.062448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696bddf-9a52-44dc-8a88-ee3e5dbf33c8 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:19.070091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 995/2026] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:26:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:19.159744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a31d-412d-4e42-b14b-8ea8c268dc00 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:19.160024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a31d-412d-4e42-b14b-8ea8c268dc00 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:19.160266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a31d-412d-4e42-b14b-8ea8c268dc00 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:19.161628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1032/2027] 10.222.0.23 () {54 vars in 921 bytes} [Thu Oct 27 01:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:19.167213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aad3b-7825-4e6b-b6c5-904ee9fff3ea None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:19.167501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aad3b-7825-4e6b-b6c5-904ee9fff3ea None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:19.167775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aad3b-7825-4e6b-b6c5-904ee9fff3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:19.189243 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-049aad3b-7825-4e6b-b6c5-904ee9fff3ea None None] MFA Rules not processed for user `8af81f74f98b478ab71c0b22b365e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:19.190430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-049aad3b-7825-4e6b-b6c5-904ee9fff3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:19.205141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 996/2028] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Oct 27 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:19.217700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0a31d-412d-4e42-b14b-8ea8c268dc00 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:19.219848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dbb0a31d-412d-4e42-b14b-8ea8c268dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:19.235008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0a31d-412d-4e42-b14b-8ea8c268dc00 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:19.239154 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4540e4-ac97-436d-9308-1c27d3e9b837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:19.239758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4540e4-ac97-436d-9308-1c27d3e9b837 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:19.240035 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4540e4-ac97-436d-9308-1c27d3e9b837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:19.240319 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4540e4-ac97-436d-9308-1c27d3e9b837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:19.251505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4540e4-ac97-436d-9308-1c27d3e9b837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:19.252998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4540e4-ac97-436d-9308-1c27d3e9b837 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:19.267766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1033/2029] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:26:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:21.995739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e8394-d424-42b9-836a-cc50aa33c9b1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.996574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e8394-d424-42b9-836a-cc50aa33c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.996574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e8394-d424-42b9-836a-cc50aa33c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:22.016500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-997e8394-d424-42b9-836a-cc50aa33c9b1 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:22.017707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-997e8394-d424-42b9-836a-cc50aa33c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:22.025879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 997/2030] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:22.038281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4540e4-ac97-436d-9308-1c27d3e9b837 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:22.050509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4540e4-ac97-436d-9308-1c27d3e9b837 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:22.056692 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c0072-72f3-4f5d-b553-114568201c87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:22.057268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c0072-72f3-4f5d-b553-114568201c87 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:22.057645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c0072-72f3-4f5d-b553-114568201c87 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:22.057915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c0072-72f3-4f5d-b553-114568201c87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:22.066365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c0072-72f3-4f5d-b553-114568201c87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:22.067990 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c0072-72f3-4f5d-b553-114568201c87 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:22.076622 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1034/2031] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:26:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 01:26:32.010953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=43 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:32.073429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=61 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:39.698925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f44732-86af-431e-8528-7bf73a9bcc66 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.699422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f44732-86af-431e-8528-7bf73a9bcc66 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.699520 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f44732-86af-431e-8528-7bf73a9bcc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.719124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-06f44732-86af-431e-8528-7bf73a9bcc66 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:39.720356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-06f44732-86af-431e-8528-7bf73a9bcc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:39.728173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 998/2032] 10.222.0.23 () {58 vars in 967 bytes} [Thu Oct 27 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:39.741593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c0072-72f3-4f5d-b553-114568201c87 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:39.753155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c0072-72f3-4f5d-b553-114568201c87 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:39.759500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f547c6-c915-4c6a-86bb-be3f83257023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:39.760134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f547c6-c915-4c6a-86bb-be3f83257023 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.760428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f547c6-c915-4c6a-86bb-be3f83257023 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.760701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f547c6-c915-4c6a-86bb-be3f83257023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.770008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f547c6-c915-4c6a-86bb-be3f83257023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:39.771681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f547c6-c915-4c6a-86bb-be3f83257023 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:39.780106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1035/2033] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:26:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:49.713889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:49.776894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:10.414403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934c486-58db-42f6-b23b-57f53a4c63d5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:10.415000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934c486-58db-42f6-b23b-57f53a4c63d5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:10.415000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934c486-58db-42f6-b23b-57f53a4c63d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:10.435369 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c934c486-58db-42f6-b23b-57f53a4c63d5 None None] MFA Rules not processed for user `2e9eb6b2ff274a8e810c3785a295e741`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:10.436596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c934c486-58db-42f6-b23b-57f53a4c63d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:10.498576 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 999/2034] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:27:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:20.255654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f547c6-c915-4c6a-86bb-be3f83257023 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:20.257203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b6f547c6-c915-4c6a-86bb-be3f83257023 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:20.331333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f547c6-c915-4c6a-86bb-be3f83257023 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:20.336592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8749e48-33f4-4bb0-9367-b67aaf6a4b03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:20.337217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8749e48-33f4-4bb0-9367-b67aaf6a4b03 service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:20.337513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8749e48-33f4-4bb0-9367-b67aaf6a4b03 service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:20.337775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8749e48-33f4-4bb0-9367-b67aaf6a4b03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:20.339582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b8749e48-33f4-4bb0-9367-b67aaf6a4b03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:20.351768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8749e48-33f4-4bb0-9367-b67aaf6a4b03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:20.353415 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8749e48-33f4-4bb0-9367-b67aaf6a4b03 service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:20.363868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1036/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:27:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:20.490417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=25 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:24.462429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44165748-9265-434f-8101-695b8919e742 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:24.463044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44165748-9265-434f-8101-695b8919e742 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:24.463044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44165748-9265-434f-8101-695b8919e742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:24.482518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-44165748-9265-434f-8101-695b8919e742 None None] MFA Rules not processed for user `c37589330ceb4193a7a504600b4ced84`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:24.483736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-44165748-9265-434f-8101-695b8919e742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:24.541526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1000/2036] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:30.359419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=32 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:34.533414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=25 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:42.768791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fc662-0ec2-421a-9515-87aa31985b44 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:42.769298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fc662-0ec2-421a-9515-87aa31985b44 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:42.769298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fc662-0ec2-421a-9515-87aa31985b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:42.789351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3e9fc662-0ec2-421a-9515-87aa31985b44 None None] MFA Rules not processed for user `563728f1570c48c3b79bf36e32681a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:42.790568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3e9fc662-0ec2-421a-9515-87aa31985b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:42.856670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1037/2037] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:27:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:52.849089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=25 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:13.186743 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44165748-9265-434f-8101-695b8919e742 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:13.188443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-44165748-9265-434f-8101-695b8919e742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:13.255924 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44165748-9265-434f-8101-695b8919e742 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:13.261164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:13.261802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:13.262087 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:13.262361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] PATH_INFO: `/v3/users/2e9eb6b2ff274a8e810c3785a295e741` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:13.263654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9eb6b2ff274a8e810c3785a295e741)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:13.265628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:13.315270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9eb6b2ff274a8e810c3785a295e741'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.322804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9eb6b2ff274a8e810c3785a295e741'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.335484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9eb6b2ff274a8e810c3785a295e741'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.343694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9eb6b2ff274a8e810c3785a295e741'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.344413 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-49ccb0cc-b466-4050-b100-85ce763d26e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9eb6b2ff274a8e810c3785a295e741'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.350885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1001/2038] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:28:13 2022] DELETE /identity/v3/users/2e9eb6b2ff274a8e810c3785a295e741 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:28:13.533709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fc662-0ec2-421a-9515-87aa31985b44 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:13.547004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fc662-0ec2-421a-9515-87aa31985b44 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:13.605826 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:13.606382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:13.606658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:13.606960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] PATH_INFO: `/v3/projects/eb551584d4874e37aaa7585e6cfc10f0` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:13.608276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb551584d4874e37aaa7585e6cfc10f0)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:13.610215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:13.659225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb551584d4874e37aaa7585e6cfc10f0', 'request_id': 'req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.665363 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb551584d4874e37aaa7585e6cfc10f0', 'request_id': 'req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.671907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb551584d4874e37aaa7585e6cfc10f0', 'request_id': 'req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.686466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] The token cache is being invalidate because project eb551584d4874e37aaa7585e6cfc10f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:28:13.686865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.687513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a03b74a6-8ed8-441c-96fc-1cd79ac6d991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:13.689100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1038/2039] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:28:13 2022] DELETE /identity/v3/projects/eb551584d4874e37aaa7585e6cfc10f0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:28:13.694349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679610c7-ba47-4252-a3d2-22642da47615 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:13.694637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679610c7-ba47-4252-a3d2-22642da47615 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:13.694938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679610c7-ba47-4252-a3d2-22642da47615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:13.715274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-679610c7-ba47-4252-a3d2-22642da47615 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:13.716452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-679610c7-ba47-4252-a3d2-22642da47615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:13.776157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1002/2040] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:13.788132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29809d-7320-4521-b524-df855b00b2cb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:13.788404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29809d-7320-4521-b524-df855b00b2cb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:13.788712 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29809d-7320-4521-b524-df855b00b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:13.811951 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4e29809d-7320-4521-b524-df855b00b2cb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:13.813150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4e29809d-7320-4521-b524-df855b00b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:13.821657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1039/2041] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:13.826270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679610c7-ba47-4252-a3d2-22642da47615 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:13.836966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679610c7-ba47-4252-a3d2-22642da47615 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:13.842383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0a0f1-a5d0-4c6b-b6e4-8477392244dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:13.843052 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0a0f1-a5d0-4c6b-b6e4-8477392244dc admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:13.843330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0a0f1-a5d0-4c6b-b6e4-8477392244dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:13.843623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0a0f1-a5d0-4c6b-b6e4-8477392244dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:13.844279 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0a0f1-a5d0-4c6b-b6e4-8477392244dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:28:13.844579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0a0f1-a5d0-4c6b-b6e4-8477392244dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:13.846172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0a0f1-a5d0-4c6b-b6e4-8477392244dc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:13.858633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1003/2042] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:28:13.863420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29809d-7320-4521-b524-df855b00b2cb None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:13.873589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29809d-7320-4521-b524-df855b00b2cb None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:13.882241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d8119-e445-4201-b227-86b7fe834428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:13.883129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d8119-e445-4201-b227-86b7fe834428 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:13.883452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d8119-e445-4201-b227-86b7fe834428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:13.883762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d8119-e445-4201-b227-86b7fe834428 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:13.884633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d8119-e445-4201-b227-86b7fe834428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:13.887533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d8119-e445-4201-b227-86b7fe834428 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:13.923162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1040/2043] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:28:13 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:28:13.927787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0a0f1-a5d0-4c6b-b6e4-8477392244dc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:13.937932 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0a0f1-a5d0-4c6b-b6e4-8477392244dc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:13.941738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:13.997137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6df4c9-411e-4023-a4c2-82a63a55f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:13.997762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6df4c9-411e-4023-a4c2-82a63a55f065 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:13.998042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6df4c9-411e-4023-a4c2-82a63a55f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:13.998320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6df4c9-411e-4023-a4c2-82a63a55f065 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:13.999105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6df4c9-411e-4023-a4c2-82a63a55f065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:14.001035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6df4c9-411e-4023-a4c2-82a63a55f065 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:14.021567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1004/2044] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:28:13 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:28:14.025950 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d8119-e445-4201-b227-86b7fe834428 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:14.036594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d8119-e445-4201-b227-86b7fe834428 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:14.042045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882378f6-9c69-4f35-abfa-92b50f964fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:14.042662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882378f6-9c69-4f35-abfa-92b50f964fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:14.042978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882378f6-9c69-4f35-abfa-92b50f964fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:14.043247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882378f6-9c69-4f35-abfa-92b50f964fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:14.043941 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882378f6-9c69-4f35-abfa-92b50f964fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:14.045546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882378f6-9c69-4f35-abfa-92b50f964fe4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:14.055959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1041/2045] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:28:14.060178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6df4c9-411e-4023-a4c2-82a63a55f065 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:14.070562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6df4c9-411e-4023-a4c2-82a63a55f065 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:14.075804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5b7eb-b8be-41f9-914d-0c39d079df91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:14.076417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5b7eb-b8be-41f9-914d-0c39d079df91 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:14.076704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5b7eb-b8be-41f9-914d-0c39d079df91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:14.076975 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5b7eb-b8be-41f9-914d-0c39d079df91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:14.077643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5b7eb-b8be-41f9-914d-0c39d079df91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:14.079266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5b7eb-b8be-41f9-914d-0c39d079df91 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:14.090412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1005/2046] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:28:14.094998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882378f6-9c69-4f35-abfa-92b50f964fe4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:14.105486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882378f6-9c69-4f35-abfa-92b50f964fe4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:14.111161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8faae3-2904-455d-8800-932ef59b413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:14.111755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8faae3-2904-455d-8800-932ef59b413e admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:14.112043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8faae3-2904-455d-8800-932ef59b413e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:14.112319 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8faae3-2904-455d-8800-932ef59b413e admin admin] PATH_INFO: `/v3/projects/fb598d3ee76240ca9fcceddf9670b64e/users/cdaa7f35aa2a45d7acfc9a00d63a6d2b/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:14.127339 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8faae3-2904-455d-8800-932ef59b413e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb598d3ee76240ca9fcceddf9670b64e, user_id=cdaa7f35aa2a45d7acfc9a00d63a6d2b, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:14.129973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8faae3-2904-455d-8800-932ef59b413e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:14.143663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1042/2047] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:28:14 2022] PUT /identity/v3/projects/fb598d3ee76240ca9fcceddf9670b64e/users/cdaa7f35aa2a45d7acfc9a00d63a6d2b/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:28:14.148970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a017e-adfd-4746-b210-e9fed45c389d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:14.149082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a017e-adfd-4746-b210-e9fed45c389d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:14.149360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a017e-adfd-4746-b210-e9fed45c389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:14.169209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-514a017e-adfd-4746-b210-e9fed45c389d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:14.170464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-514a017e-adfd-4746-b210-e9fed45c389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:14.231302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1006/2048] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:14.241441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8faae3-2904-455d-8800-932ef59b413e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:14.243452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5e8faae3-2904-455d-8800-932ef59b413e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:14.275720 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:14.303817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8faae3-2904-455d-8800-932ef59b413e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:14.308302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcb103-946d-43d6-a2a1-87002c70efe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:14.308914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcb103-946d-43d6-a2a1-87002c70efe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:14.309214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcb103-946d-43d6-a2a1-87002c70efe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:14.309472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcb103-946d-43d6-a2a1-87002c70efe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:14.319792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcb103-946d-43d6-a2a1-87002c70efe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:14.321222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcb103-946d-43d6-a2a1-87002c70efe7 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:14.331295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1043/2049] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:28:18.281091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13013b-867a-4930-81aa-9cd506448006 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:18.281680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13013b-867a-4930-81aa-9cd506448006 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:18.281680 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13013b-867a-4930-81aa-9cd506448006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:18.323280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-eb13013b-867a-4930-81aa-9cd506448006 None None] MFA Rules not processed for user `cdaa7f35aa2a45d7acfc9a00d63a6d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:18.324786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb13013b-867a-4930-81aa-9cd506448006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:18.470514 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1007/2050] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:18.472363 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcb103-946d-43d6-a2a1-87002c70efe7 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:18.475129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bffcb103-946d-43d6-a2a1-87002c70efe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:18.581874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcb103-946d-43d6-a2a1-87002c70efe7 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:18.589243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916110e-79c0-4b85-9168-d8c8d711c1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:18.589885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916110e-79c0-4b85-9168-d8c8d711c1d0 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:18.590167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916110e-79c0-4b85-9168-d8c8d711c1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:18.591090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916110e-79c0-4b85-9168-d8c8d711c1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:18.600153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916110e-79c0-4b85-9168-d8c8d711c1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:18.601747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916110e-79c0-4b85-9168-d8c8d711c1d0 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:18.611761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1044/2051] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:28:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:28:19.975114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1383c4-a1a5-43d8-8dcb-81cbef80b57c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:19.975620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1383c4-a1a5-43d8-8dcb-81cbef80b57c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:19.975718 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1383c4-a1a5-43d8-8dcb-81cbef80b57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:19.996206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-dd1383c4-a1a5-43d8-8dcb-81cbef80b57c None None] MFA Rules not processed for user `cdaa7f35aa2a45d7acfc9a00d63a6d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:19.997392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dd1383c4-a1a5-43d8-8dcb-81cbef80b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:20.004763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1008/2052] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:28:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:28.607195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=48 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:29.989912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:32.203307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1482d-ecce-47ab-bf06-3432f6de16f1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:32.204379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1482d-ecce-47ab-bf06-3432f6de16f1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:32.204733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1482d-ecce-47ab-bf06-3432f6de16f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:32.226353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-39b1482d-ecce-47ab-bf06-3432f6de16f1 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:32.228010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-39b1482d-ecce-47ab-bf06-3432f6de16f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:32.297306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1045/2053] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:28:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:32.358099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1383c4-a1a5-43d8-8dcb-81cbef80b57c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:32.359763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dd1383c4-a1a5-43d8-8dcb-81cbef80b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:32.432576 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1383c4-a1a5-43d8-8dcb-81cbef80b57c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:32.439165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8d73-233c-4816-a56a-a09e75a0379d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:32.439985 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8d73-233c-4816-a56a-a09e75a0379d service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:32.440330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8d73-233c-4816-a56a-a09e75a0379d service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:32.440632 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8d73-233c-4816-a56a-a09e75a0379d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:32.449928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c8d73-233c-4816-a56a-a09e75a0379d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:32.451557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c8d73-233c-4816-a56a-a09e75a0379d service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:32.460170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1009/2054] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:28:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:28:42.284911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=25 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:42.456888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=32 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:46.179544 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1482d-ecce-47ab-bf06-3432f6de16f1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:46.189682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1482d-ecce-47ab-bf06-3432f6de16f1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:46.193449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1e31d-e830-433b-9467-4e61e8dcf6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:46.194063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1e31d-e830-433b-9467-4e61e8dcf6cd service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:46.194343 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1e31d-e830-433b-9467-4e61e8dcf6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:46.194612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1e31d-e830-433b-9467-4e61e8dcf6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:46.196374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-27c1e31d-e830-433b-9467-4e61e8dcf6cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:46.209894 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1e31d-e830-433b-9467-4e61e8dcf6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:46.211354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1e31d-e830-433b-9467-4e61e8dcf6cd service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:46.222588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1046/2055] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:28:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:28:49.682995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8d73-233c-4816-a56a-a09e75a0379d service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:49.697213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8d73-233c-4816-a56a-a09e75a0379d service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:49.701086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa87236-4fac-465f-9b3b-27aad989bcbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:49.701938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa87236-4fac-465f-9b3b-27aad989bcbb service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:49.702689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa87236-4fac-465f-9b3b-27aad989bcbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:49.703170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa87236-4fac-465f-9b3b-27aad989bcbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:49.705629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9aa87236-4fac-465f-9b3b-27aad989bcbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:49.721335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa87236-4fac-465f-9b3b-27aad989bcbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:49.723348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa87236-4fac-465f-9b3b-27aad989bcbb service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:49.738287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1010/2056] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:28:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:28:50.601347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9266db-281e-4de2-b257-94e044a4bf9b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:50.601861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9266db-281e-4de2-b257-94e044a4bf9b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:50.601952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9266db-281e-4de2-b257-94e044a4bf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:50.624356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8f9266db-281e-4de2-b257-94e044a4bf9b None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:50.625595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8f9266db-281e-4de2-b257-94e044a4bf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:50.633181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1047/2057] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:50.646939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa87236-4fac-465f-9b3b-27aad989bcbb service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:50.658564 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa87236-4fac-465f-9b3b-27aad989bcbb service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:50.663573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6dc92-1dad-412b-83dc-8a8dce33da22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:50.664184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6dc92-1dad-412b-83dc-8a8dce33da22 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:50.664462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6dc92-1dad-412b-83dc-8a8dce33da22 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:50.664731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6dc92-1dad-412b-83dc-8a8dce33da22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:50.672844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6dc92-1dad-412b-83dc-8a8dce33da22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:50.674540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6dc92-1dad-412b-83dc-8a8dce33da22 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:50.683124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1011/2058] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:28:55.606245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9266db-281e-4de2-b257-94e044a4bf9b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:55.616087 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9266db-281e-4de2-b257-94e044a4bf9b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:55.620412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5634a-f337-47cb-bae6-22709b4e23eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:55.621015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5634a-f337-47cb-bae6-22709b4e23eb service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:55.621292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5634a-f337-47cb-bae6-22709b4e23eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:55.621558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5634a-f337-47cb-bae6-22709b4e23eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:55.623457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-88d5634a-f337-47cb-bae6-22709b4e23eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:55.636393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5634a-f337-47cb-bae6-22709b4e23eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:55.637817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5634a-f337-47cb-bae6-22709b4e23eb service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:55.648194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1048/2059] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:28:59.539127 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc674-398e-453a-8562-1420e99c11a4 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:59.539845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc674-398e-453a-8562-1420e99c11a4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:59.539845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc674-398e-453a-8562-1420e99c11a4 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:59.541363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1012/2060] 10.222.0.23 () {54 vars in 961 bytes} [Thu Oct 27 01:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:28:59.547089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c500d09-256f-4c61-a1cc-67fd352d2ffa None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:59.547666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c500d09-256f-4c61-a1cc-67fd352d2ffa None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:59.547666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c500d09-256f-4c61-a1cc-67fd352d2ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:59.567486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6c500d09-256f-4c61-a1cc-67fd352d2ffa None None] MFA Rules not processed for user `bc32363c074f4418964ea46068a28831`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:59.569182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6c500d09-256f-4c61-a1cc-67fd352d2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:59.612022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc674-398e-453a-8562-1420e99c11a4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:59.613912 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f34bc674-398e-453a-8562-1420e99c11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:59.632380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc674-398e-453a-8562-1420e99c11a4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:59.637083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:59.637725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:59.638008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:59.638286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] PATH_INFO: `/v3/users/563728f1570c48c3b79bf36e32681a14` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:59.639568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563728f1570c48c3b79bf36e32681a14)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:59.641443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:59.646460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1049/2061] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Oct 27 01:28:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:59.654010 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c500d09-256f-4c61-a1cc-67fd352d2ffa None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:59.663697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c500d09-256f-4c61-a1cc-67fd352d2ffa None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:59.670006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d04498-6028-4ee6-a68e-95fef12b82e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:59.670627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d04498-6028-4ee6-a68e-95fef12b82e5 service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:59.670962 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d04498-6028-4ee6-a68e-95fef12b82e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:59.671240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d04498-6028-4ee6-a68e-95fef12b82e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:59.673151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-20d04498-6028-4ee6-a68e-95fef12b82e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:59.686611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d04498-6028-4ee6-a68e-95fef12b82e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:59.688413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d04498-6028-4ee6-a68e-95fef12b82e5 service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:59.692204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563728f1570c48c3b79bf36e32681a14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:59.698673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1050/2062] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:28:59.699930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563728f1570c48c3b79bf36e32681a14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:59.712505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563728f1570c48c3b79bf36e32681a14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:59.720965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563728f1570c48c3b79bf36e32681a14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:59.721628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd0473d0-7a45-48c5-a216-c9c01544c176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563728f1570c48c3b79bf36e32681a14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:59.731246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1013/2063] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:28:59 2022] DELETE /identity/v3/users/563728f1570c48c3b79bf36e32681a14 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:28:59.955991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d04498-6028-4ee6-a68e-95fef12b82e5 service placement] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:59.973409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d04498-6028-4ee6-a68e-95fef12b82e5 service placement] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:00.039176 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:00.039834 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.040108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.040382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] PATH_INFO: `/v3/projects/4e45034653c340bba4dcb450b83175b7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.041523 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e45034653c340bba4dcb450b83175b7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:00.043460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:00.090277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e45034653c340bba4dcb450b83175b7', 'request_id': 'req-fb6f4004-4909-48df-be62-9912929f4c34'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:00.092190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:00.096496 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e45034653c340bba4dcb450b83175b7', 'request_id': 'req-fb6f4004-4909-48df-be62-9912929f4c34'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:00.103011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e45034653c340bba4dcb450b83175b7', 'request_id': 'req-fb6f4004-4909-48df-be62-9912929f4c34'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:00.115711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] The token cache is being invalidate because project 4e45034653c340bba4dcb450b83175b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:00.116001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:00.116632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fb6f4004-4909-48df-be62-9912929f4c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:00.118516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1051/2064] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:28:59 2022] DELETE /identity/v3/projects/4e45034653c340bba4dcb450b83175b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:00.123769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ace11-0ae1-49ae-b9e1-6d153e820353 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.124120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ace11-0ae1-49ae-b9e1-6d153e820353 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.124459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ace11-0ae1-49ae-b9e1-6d153e820353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.144145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b83ace11-0ae1-49ae-b9e1-6d153e820353 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:00.145331 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b83ace11-0ae1-49ae-b9e1-6d153e820353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:00.236312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1014/2065] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:00.244082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6858e6-ee93-49ce-8abb-66cc60c39500 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.244537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6858e6-ee93-49ce-8abb-66cc60c39500 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.247466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6858e6-ee93-49ce-8abb-66cc60c39500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.278350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-da6858e6-ee93-49ce-8abb-66cc60c39500 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:00.279953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-da6858e6-ee93-49ce-8abb-66cc60c39500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:00.288458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1052/2066] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:00.292425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ace11-0ae1-49ae-b9e1-6d153e820353 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:00.304556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ace11-0ae1-49ae-b9e1-6d153e820353 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:00.310088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0b3f1-02d1-485a-bc1d-4ca90b31b449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:00.310764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0b3f1-02d1-485a-bc1d-4ca90b31b449 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.311045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0b3f1-02d1-485a-bc1d-4ca90b31b449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.311317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0b3f1-02d1-485a-bc1d-4ca90b31b449 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.311976 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0b3f1-02d1-485a-bc1d-4ca90b31b449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:00.312278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0b3f1-02d1-485a-bc1d-4ca90b31b449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:00.313888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0b3f1-02d1-485a-bc1d-4ca90b31b449 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:00.330743 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1015/2067] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:29:00.331968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6858e6-ee93-49ce-8abb-66cc60c39500 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:00.342053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6858e6-ee93-49ce-8abb-66cc60c39500 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:00.347009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a491c1-844d-4955-afa9-c6da075dec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:00.347889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a491c1-844d-4955-afa9-c6da075dec0f admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.348164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a491c1-844d-4955-afa9-c6da075dec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.348437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a491c1-844d-4955-afa9-c6da075dec0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.349098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a491c1-844d-4955-afa9-c6da075dec0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:00.351229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a491c1-844d-4955-afa9-c6da075dec0f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:00.384109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1053/2068] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:00 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:00.388269 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0b3f1-02d1-485a-bc1d-4ca90b31b449 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:00.399168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0b3f1-02d1-485a-bc1d-4ca90b31b449 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:00.429548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:00.459456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81938eb-34bf-4a88-9d1d-c6b7b6e82c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:00.460067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81938eb-34bf-4a88-9d1d-c6b7b6e82c32 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.460344 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81938eb-34bf-4a88-9d1d-c6b7b6e82c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.460611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81938eb-34bf-4a88-9d1d-c6b7b6e82c32 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.461381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81938eb-34bf-4a88-9d1d-c6b7b6e82c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:00.463363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81938eb-34bf-4a88-9d1d-c6b7b6e82c32 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:00.486264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1016/2069] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:00 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:00.490503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a491c1-844d-4955-afa9-c6da075dec0f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:00.502170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a491c1-844d-4955-afa9-c6da075dec0f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:00.507783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27f0b5-b107-45b8-9876-89804d5e9380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:00.508390 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27f0b5-b107-45b8-9876-89804d5e9380 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.508666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27f0b5-b107-45b8-9876-89804d5e9380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.508945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27f0b5-b107-45b8-9876-89804d5e9380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.509574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27f0b5-b107-45b8-9876-89804d5e9380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:00.511243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27f0b5-b107-45b8-9876-89804d5e9380 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:00.521402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1054/2070] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:00.525621 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81938eb-34bf-4a88-9d1d-c6b7b6e82c32 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:00.536283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81938eb-34bf-4a88-9d1d-c6b7b6e82c32 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:00.542190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800f865-68ab-4b7b-b8e2-850c6a217c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:00.542828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f865-68ab-4b7b-b8e2-850c6a217c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.543107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f865-68ab-4b7b-b8e2-850c6a217c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.543375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f865-68ab-4b7b-b8e2-850c6a217c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.544028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800f865-68ab-4b7b-b8e2-850c6a217c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:00.545620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800f865-68ab-4b7b-b8e2-850c6a217c3f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:00.556685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1017/2071] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:29:00.560927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27f0b5-b107-45b8-9876-89804d5e9380 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:00.571415 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27f0b5-b107-45b8-9876-89804d5e9380 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:00.576504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242a8de-530e-4517-b582-09c6d40fa162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:00.577155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242a8de-530e-4517-b582-09c6d40fa162 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.577429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242a8de-530e-4517-b582-09c6d40fa162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.577698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242a8de-530e-4517-b582-09c6d40fa162 admin admin] PATH_INFO: `/v3/projects/cbb21971fc974f01bc1e7c06fcb8d444/users/81affe710e974e738f03a18caf8d080c/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.594138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242a8de-530e-4517-b582-09c6d40fa162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb21971fc974f01bc1e7c06fcb8d444, user_id=81affe710e974e738f03a18caf8d080c, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:00.597431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242a8de-530e-4517-b582-09c6d40fa162 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:00.622813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1055/2072] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:00 2022] PUT /identity/v3/projects/cbb21971fc974f01bc1e7c06fcb8d444/users/81affe710e974e738f03a18caf8d080c/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:00.632356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae120b09-24c0-45dc-84e6-1ddc47d6d27b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.632733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae120b09-24c0-45dc-84e6-1ddc47d6d27b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.633081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae120b09-24c0-45dc-84e6-1ddc47d6d27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.669393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ae120b09-24c0-45dc-84e6-1ddc47d6d27b None None] MFA Rules not processed for user `81affe710e974e738f03a18caf8d080c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:00.670761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ae120b09-24c0-45dc-84e6-1ddc47d6d27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:00.740803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1018/2073] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:00.745852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242a8de-530e-4517-b582-09c6d40fa162 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:00.808628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242a8de-530e-4517-b582-09c6d40fa162 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:00.813267 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aba00-e5f4-49cd-99bf-97002bc2177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:00.813923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aba00-e5f4-49cd-99bf-97002bc2177b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.814208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aba00-e5f4-49cd-99bf-97002bc2177b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.814456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aba00-e5f4-49cd-99bf-97002bc2177b admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.815126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4aba00-e5f4-49cd-99bf-97002bc2177b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:00.817015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4aba00-e5f4-49cd-99bf-97002bc2177b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:00.845725 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1056/2074] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:00 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:00.849919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae120b09-24c0-45dc-84e6-1ddc47d6d27b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:00.861097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae120b09-24c0-45dc-84e6-1ddc47d6d27b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:00.929537 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4913be0-4122-430a-ad54-175d86fc20bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:00.930148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4913be0-4122-430a-ad54-175d86fc20bf admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:00.930429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4913be0-4122-430a-ad54-175d86fc20bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:00.930699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4913be0-4122-430a-ad54-175d86fc20bf admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:00.931366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4913be0-4122-430a-ad54-175d86fc20bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:00.933288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4913be0-4122-430a-ad54-175d86fc20bf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:00.959966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1019/2075] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:00 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:00.961799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aba00-e5f4-49cd-99bf-97002bc2177b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:00.998597 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aba00-e5f4-49cd-99bf-97002bc2177b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:01.015820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae78d-514c-4139-9231-a2366381dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:01.016960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae78d-514c-4139-9231-a2366381dccf admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:01.017309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae78d-514c-4139-9231-a2366381dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:01.018138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae78d-514c-4139-9231-a2366381dccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:01.018908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae78d-514c-4139-9231-a2366381dccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:01.022014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae78d-514c-4139-9231-a2366381dccf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:01.039048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1057/2076] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:01.046764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4913be0-4122-430a-ad54-175d86fc20bf admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:01.087998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4913be0-4122-430a-ad54-175d86fc20bf admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:01.110627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9498fb-9b88-4934-92eb-89ef2d54f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:01.112018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9498fb-9b88-4934-92eb-89ef2d54f982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:01.112643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9498fb-9b88-4934-92eb-89ef2d54f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:01.113251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9498fb-9b88-4934-92eb-89ef2d54f982 admin admin] PATH_INFO: `/v3/projects/679bf2a4de3d47d09b0f9dda2108bc8e/users/a6882e02b6d24aabb53bbcb092e58fec/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:01.142130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9498fb-9b88-4934-92eb-89ef2d54f982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679bf2a4de3d47d09b0f9dda2108bc8e, user_id=a6882e02b6d24aabb53bbcb092e58fec, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:01.147544 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9498fb-9b88-4934-92eb-89ef2d54f982 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:01.224195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1020/2077] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:01 2022] PUT /identity/v3/projects/679bf2a4de3d47d09b0f9dda2108bc8e/users/a6882e02b6d24aabb53bbcb092e58fec/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:01.228399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae78d-514c-4139-9231-a2366381dccf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:01.238135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae78d-514c-4139-9231-a2366381dccf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:01.292647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:01.308424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ed22d-eb94-4135-ba24-c0ef3d15275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:01.309361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ed22d-eb94-4135-ba24-c0ef3d15275a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:01.310090 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ed22d-eb94-4135-ba24-c0ef3d15275a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:01.310457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ed22d-eb94-4135-ba24-c0ef3d15275a admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:01.311317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ed22d-eb94-4135-ba24-c0ef3d15275a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:01.312940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ed22d-eb94-4135-ba24-c0ef3d15275a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:01.324429 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1058/2078] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:01.332250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9498fb-9b88-4934-92eb-89ef2d54f982 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:01.354262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9498fb-9b88-4934-92eb-89ef2d54f982 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:01.368870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5067ae-2891-4017-8ec2-49cc58499cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:01.368870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5067ae-2891-4017-8ec2-49cc58499cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:01.368870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5067ae-2891-4017-8ec2-49cc58499cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:01.368870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5067ae-2891-4017-8ec2-49cc58499cee admin admin] PATH_INFO: `/v3/projects/679bf2a4de3d47d09b0f9dda2108bc8e/users/a6882e02b6d24aabb53bbcb092e58fec/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:01.371596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5067ae-2891-4017-8ec2-49cc58499cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=679bf2a4de3d47d09b0f9dda2108bc8e, user_id=a6882e02b6d24aabb53bbcb092e58fec, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:01.374524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5067ae-2891-4017-8ec2-49cc58499cee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:01.377102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:01.406265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1021/2079] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:01 2022] PUT /identity/v3/projects/679bf2a4de3d47d09b0f9dda2108bc8e/users/a6882e02b6d24aabb53bbcb092e58fec/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:01.406925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633100c-5a9f-4f1f-b9aa-786328047a03 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:01.407221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633100c-5a9f-4f1f-b9aa-786328047a03 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:01.407511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633100c-5a9f-4f1f-b9aa-786328047a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:01.439621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e633100c-5a9f-4f1f-b9aa-786328047a03 None None] MFA Rules not processed for user `a6882e02b6d24aabb53bbcb092e58fec`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:01.440846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e633100c-5a9f-4f1f-b9aa-786328047a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:01.523418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1059/2080] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:01.534751 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5067ae-2891-4017-8ec2-49cc58499cee admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:01.536549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fb5067ae-2891-4017-8ec2-49cc58499cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:01.600325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5067ae-2891-4017-8ec2-49cc58499cee admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:01.604112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c71e1-6b4c-48cf-b0f1-e3ede4f64ffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:01.604725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c71e1-6b4c-48cf-b0f1-e3ede4f64ffa service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:01.604977 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c71e1-6b4c-48cf-b0f1-e3ede4f64ffa service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:01.605242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c71e1-6b4c-48cf-b0f1-e3ede4f64ffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:01.614477 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c71e1-6b4c-48cf-b0f1-e3ede4f64ffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:01.616004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c71e1-6b4c-48cf-b0f1-e3ede4f64ffa service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:01.625644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1022/2081] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:01.712163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633100c-5a9f-4f1f-b9aa-786328047a03 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:01.723485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633100c-5a9f-4f1f-b9aa-786328047a03 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:01.727789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1199da-064c-4962-8595-aaf53b7b3dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:01.728628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1199da-064c-4962-8595-aaf53b7b3dce service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:01.728996 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1199da-064c-4962-8595-aaf53b7b3dce service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:01.729368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1199da-064c-4962-8595-aaf53b7b3dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:01.788665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1199da-064c-4962-8595-aaf53b7b3dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:01.790095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1199da-064c-4962-8595-aaf53b7b3dce service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:01.798968 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1060/2082] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:08.236294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c71e1-6b4c-48cf-b0f1-e3ede4f64ffa service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:08.237897 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-109c71e1-6b4c-48cf-b0f1-e3ede4f64ffa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:08.314403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c71e1-6b4c-48cf-b0f1-e3ede4f64ffa service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:08.320577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a6f31-6b47-4b7b-a344-87272209f7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:08.321190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a6f31-6b47-4b7b-a344-87272209f7ab service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:08.321471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a6f31-6b47-4b7b-a344-87272209f7ab service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:08.321788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a6f31-6b47-4b7b-a344-87272209f7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:08.323600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3c8a6f31-6b47-4b7b-a344-87272209f7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:08.338376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1199da-064c-4962-8595-aaf53b7b3dce service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:08.339849 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ca1199da-064c-4962-8595-aaf53b7b3dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:08.386078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a6f31-6b47-4b7b-a344-87272209f7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:08.387747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a6f31-6b47-4b7b-a344-87272209f7ab service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:08.396846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1023/2083] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:08.397561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1199da-064c-4962-8595-aaf53b7b3dce service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:08.401162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f51eec-e6cf-497d-b028-c7ea38c87fff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ea18d542ca24e39ac758f34ad65e7bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:08.401778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f51eec-e6cf-497d-b028-c7ea38c87fff service glance] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:08.402056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f51eec-e6cf-497d-b028-c7ea38c87fff service glance] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:08.402442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f51eec-e6cf-497d-b028-c7ea38c87fff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:08.411803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f51eec-e6cf-497d-b028-c7ea38c87fff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:08.413257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f51eec-e6cf-497d-b028-c7ea38c87fff service glance] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:08.423005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1061/2084] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:08.452496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a6891-758d-4f09-b42b-864990ef1bc7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:08.452788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a6891-758d-4f09-b42b-864990ef1bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:08.453063 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a6891-758d-4f09-b42b-864990ef1bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:08.472799 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-570a6891-758d-4f09-b42b-864990ef1bc7 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:08.474004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-570a6891-758d-4f09-b42b-864990ef1bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:08.506400 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:08.536678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1024/2085] 10.222.0.23 () {58 vars in 967 bytes} [Thu Oct 27 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:08.550511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f51eec-e6cf-497d-b028-c7ea38c87fff service glance] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:08.552079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-14f51eec-e6cf-497d-b028-c7ea38c87fff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:08.567574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:08.624211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f51eec-e6cf-497d-b028-c7ea38c87fff service glance] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:08.629744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf90bf-3820-4bde-af61-4760d065f881 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:08.630384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf90bf-3820-4bde-af61-4760d065f881 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:08.630660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf90bf-3820-4bde-af61-4760d065f881 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:08.630997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf90bf-3820-4bde-af61-4760d065f881 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:08.639790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf90bf-3820-4bde-af61-4760d065f881 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:08.641357 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf90bf-3820-4bde-af61-4760d065f881 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:08.649512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1062/2086] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:29:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:29:14.291635 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9fd3b-778e-4b34-ac9f-13d140fa5ee7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:14.292137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9fd3b-778e-4b34-ac9f-13d140fa5ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:14.292137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9fd3b-778e-4b34-ac9f-13d140fa5ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:14.312851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-49f9fd3b-778e-4b34-ac9f-13d140fa5ee7 None None] MFA Rules not processed for user `cdaa7f35aa2a45d7acfc9a00d63a6d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:14.314215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-49f9fd3b-778e-4b34-ac9f-13d140fa5ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:14.372406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1025/2087] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:14.725008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf90bf-3820-4bde-af61-4760d065f881 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:14.726623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-87bf90bf-3820-4bde-af61-4760d065f881 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:14.784026 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf90bf-3820-4bde-af61-4760d065f881 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:14.787981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf3eae-0a51-4219-991b-53e916cb6c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:14.788585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf3eae-0a51-4219-991b-53e916cb6c56 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:14.788857 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf3eae-0a51-4219-991b-53e916cb6c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:14.789125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf3eae-0a51-4219-991b-53e916cb6c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:14.791238 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1bdf3eae-0a51-4219-991b-53e916cb6c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:14.801152 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf3eae-0a51-4219-991b-53e916cb6c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:14.802611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf3eae-0a51-4219-991b-53e916cb6c56 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:14.811057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1063/2088] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:15.139215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9fd3b-778e-4b34-ac9f-13d140fa5ee7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:15.140810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-49f9fd3b-778e-4b34-ac9f-13d140fa5ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:15.215002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9fd3b-778e-4b34-ac9f-13d140fa5ee7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:15.220372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7606ac-3b33-4efe-aee6-91b9d0ce4c2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:15.221013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7606ac-3b33-4efe-aee6-91b9d0ce4c2d service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:15.221286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7606ac-3b33-4efe-aee6-91b9d0ce4c2d service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:15.221553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7606ac-3b33-4efe-aee6-91b9d0ce4c2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:15.223534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5a7606ac-3b33-4efe-aee6-91b9d0ce4c2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:15.236267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7606ac-3b33-4efe-aee6-91b9d0ce4c2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:15.237879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7606ac-3b33-4efe-aee6-91b9d0ce4c2d service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:15.248343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1026/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:17.298016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf3eae-0a51-4219-991b-53e916cb6c56 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:17.307399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf3eae-0a51-4219-991b-53e916cb6c56 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:17.311584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ced473-c661-4aba-9615-3f1fd69f627e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:17.312302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ced473-c661-4aba-9615-3f1fd69f627e service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:17.312580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ced473-c661-4aba-9615-3f1fd69f627e service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:17.312849 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ced473-c661-4aba-9615-3f1fd69f627e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:17.323091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f3ced473-c661-4aba-9615-3f1fd69f627e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:17.335261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ced473-c661-4aba-9615-3f1fd69f627e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:17.338504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ced473-c661-4aba-9615-3f1fd69f627e service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:17.349512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1064/2090] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:25.243916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=67 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:25.985887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7606ac-3b33-4efe-aee6-91b9d0ce4c2d service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:26.004529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7606ac-3b33-4efe-aee6-91b9d0ce4c2d service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:26.012852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db667b51-3b9a-43e9-987f-2a06a6824ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:26.013152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db667b51-3b9a-43e9-987f-2a06a6824ec2 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:26.013506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db667b51-3b9a-43e9-987f-2a06a6824ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:26.013862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db667b51-3b9a-43e9-987f-2a06a6824ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:26.015855 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-db667b51-3b9a-43e9-987f-2a06a6824ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:26.030144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db667b51-3b9a-43e9-987f-2a06a6824ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:26.032037 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db667b51-3b9a-43e9-987f-2a06a6824ec2 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:26.043029 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1027/2091] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:27.345621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=58 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:31.406991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ced473-c661-4aba-9615-3f1fd69f627e service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:31.471328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ced473-c661-4aba-9615-3f1fd69f627e service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:31.476880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:31.477515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:31.477789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:31.478061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] PATH_INFO: `/v3/users/81affe710e974e738f03a18caf8d080c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:31.479340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81affe710e974e738f03a18caf8d080c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:31.481240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:31.541961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81affe710e974e738f03a18caf8d080c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.552694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81affe710e974e738f03a18caf8d080c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.560081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81affe710e974e738f03a18caf8d080c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.560761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81affe710e974e738f03a18caf8d080c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.573644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81affe710e974e738f03a18caf8d080c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.580035 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1065/2092] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:31 2022] DELETE /identity/v3/users/81affe710e974e738f03a18caf8d080c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:31.584758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e64af-f07d-42c1-b108-472f4df14bf2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:31.585226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e64af-f07d-42c1-b108-472f4df14bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:31.585334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e64af-f07d-42c1-b108-472f4df14bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:31.607171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0c2e64af-f07d-42c1-b108-472f4df14bf2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:31.608375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0c2e64af-f07d-42c1-b108-472f4df14bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:31.670984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1028/2093] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:31.680955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:31.682637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:31.744100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0947f10-6b3c-4c36-b506-e92755b78fe0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:31.748219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca2b88-31ce-48d9-8610-e7c50239de5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:31.748828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca2b88-31ce-48d9-8610-e7c50239de5e service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:31.749103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca2b88-31ce-48d9-8610-e7c50239de5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:31.749373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca2b88-31ce-48d9-8610-e7c50239de5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:31.758932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca2b88-31ce-48d9-8610-e7c50239de5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:31.760353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca2b88-31ce-48d9-8610-e7c50239de5e service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:31.770170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1066/2094] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:32.058832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e64af-f07d-42c1-b108-472f4df14bf2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:32.060318 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0c2e64af-f07d-42c1-b108-472f4df14bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:32.075163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e64af-f07d-42c1-b108-472f4df14bf2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:32.080395 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:32.081043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:32.081325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:32.081601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] PATH_INFO: `/v3/projects/cbb21971fc974f01bc1e7c06fcb8d444` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:32.083456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb21971fc974f01bc1e7c06fcb8d444)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:32.085478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:32.146968 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb21971fc974f01bc1e7c06fcb8d444', 'request_id': 'req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.157805 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb21971fc974f01bc1e7c06fcb8d444', 'request_id': 'req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.167215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb21971fc974f01bc1e7c06fcb8d444', 'request_id': 'req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.181141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] The token cache is being invalidate because project cbb21971fc974f01bc1e7c06fcb8d444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:32.181367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.182101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.183775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1029/2095] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:32 2022] DELETE /identity/v3/projects/cbb21971fc974f01bc1e7c06fcb8d444 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:32.188076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca2b88-31ce-48d9-8610-e7c50239de5e service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:32.197930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca2b88-31ce-48d9-8610-e7c50239de5e service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:32.217409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:32.260082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:32.260742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:32.261034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:32.261301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] PATH_INFO: `/v3/users/a6882e02b6d24aabb53bbcb092e58fec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:32.262466 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6882e02b6d24aabb53bbcb092e58fec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:32.264439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:32.313534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6882e02b6d24aabb53bbcb092e58fec'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.322756 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6882e02b6d24aabb53bbcb092e58fec'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.330166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6882e02b6d24aabb53bbcb092e58fec'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.330912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6882e02b6d24aabb53bbcb092e58fec'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.344155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-92c153f8-9630-4844-899a-3dbb53e9fc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6882e02b6d24aabb53bbcb092e58fec'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.350345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1067/2096] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:32 2022] DELETE /identity/v3/users/a6882e02b6d24aabb53bbcb092e58fec => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:32.636709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:32.638238 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:32.653212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dddbe-2ebc-4ca7-b218-f4680ce3d305 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:32.713006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:32.713559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:32.713835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:32.714108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] PATH_INFO: `/v3/projects/679bf2a4de3d47d09b0f9dda2108bc8e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:32.715264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679bf2a4de3d47d09b0f9dda2108bc8e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:32.717165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:32.728920 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:32.767524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679bf2a4de3d47d09b0f9dda2108bc8e', 'request_id': 'req-e3bde090-d010-465d-8d08-15591b503590'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.775930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679bf2a4de3d47d09b0f9dda2108bc8e', 'request_id': 'req-e3bde090-d010-465d-8d08-15591b503590'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.781472 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679bf2a4de3d47d09b0f9dda2108bc8e', 'request_id': 'req-e3bde090-d010-465d-8d08-15591b503590'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.792592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] The token cache is being invalidate because project 679bf2a4de3d47d09b0f9dda2108bc8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:32.792877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.793486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e3bde090-d010-465d-8d08-15591b503590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:32.795039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1030/2097] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:32 2022] DELETE /identity/v3/projects/679bf2a4de3d47d09b0f9dda2108bc8e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:32.800106 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5ed9-f269-4838-b704-80e4ba3ed0b1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:32.800639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5ed9-f269-4838-b704-80e4ba3ed0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:32.800639 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5ed9-f269-4838-b704-80e4ba3ed0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:32.820381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-127f5ed9-f269-4838-b704-80e4ba3ed0b1 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:32.821565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-127f5ed9-f269-4838-b704-80e4ba3ed0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:32.883443 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1068/2098] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:32.895402 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99909-76f2-438f-af78-4e17839813fd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:32.895684 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99909-76f2-438f-af78-4e17839813fd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:32.895957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99909-76f2-438f-af78-4e17839813fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:32.916275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c7a99909-76f2-438f-af78-4e17839813fd None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:32.917495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c7a99909-76f2-438f-af78-4e17839813fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:32.927297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1031/2099] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:32.931669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f5ed9-f269-4838-b704-80e4ba3ed0b1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:32.941977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f5ed9-f269-4838-b704-80e4ba3ed0b1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:32.947730 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58a98-ce53-4251-9a48-bc1a6e51be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:32.948336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58a98-ce53-4251-9a48-bc1a6e51be05 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:32.948615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58a98-ce53-4251-9a48-bc1a6e51be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:32.948889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58a98-ce53-4251-9a48-bc1a6e51be05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:32.949546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58a98-ce53-4251-9a48-bc1a6e51be05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:32.949852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58a98-ce53-4251-9a48-bc1a6e51be05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:32.951501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58a98-ce53-4251-9a48-bc1a6e51be05 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:32.963549 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1069/2100] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:29:32.967628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a99909-76f2-438f-af78-4e17839813fd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:32.976793 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a99909-76f2-438f-af78-4e17839813fd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:32.981880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c794984-9ac0-4aa5-a827-eb36272c19b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:32.982478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c794984-9ac0-4aa5-a827-eb36272c19b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:32.982760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c794984-9ac0-4aa5-a827-eb36272c19b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:32.983139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c794984-9ac0-4aa5-a827-eb36272c19b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:32.983779 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c794984-9ac0-4aa5-a827-eb36272c19b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:32.985765 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c794984-9ac0-4aa5-a827-eb36272c19b6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.015524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1032/2101] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:32 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:33.019890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58a98-ce53-4251-9a48-bc1a6e51be05 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.030147 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58a98-ce53-4251-9a48-bc1a6e51be05 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.057489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:33.091099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32704c11-9338-45c2-8d81-95ad24d5af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.091729 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32704c11-9338-45c2-8d81-95ad24d5af49 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.092003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32704c11-9338-45c2-8d81-95ad24d5af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.092267 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32704c11-9338-45c2-8d81-95ad24d5af49 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.092903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32704c11-9338-45c2-8d81-95ad24d5af49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.094882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32704c11-9338-45c2-8d81-95ad24d5af49 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.118520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1070/2102] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:33 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:33.122909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c794984-9ac0-4aa5-a827-eb36272c19b6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.133453 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c794984-9ac0-4aa5-a827-eb36272c19b6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.138319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010205cf-e951-41d8-9a12-3a95a13495f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.138949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010205cf-e951-41d8-9a12-3a95a13495f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.139231 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010205cf-e951-41d8-9a12-3a95a13495f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.139503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010205cf-e951-41d8-9a12-3a95a13495f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.140147 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010205cf-e951-41d8-9a12-3a95a13495f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.141852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010205cf-e951-41d8-9a12-3a95a13495f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.151792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1033/2103] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:33.155579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32704c11-9338-45c2-8d81-95ad24d5af49 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.165379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32704c11-9338-45c2-8d81-95ad24d5af49 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.170198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54851fef-b52c-4c8c-b3c8-bedf8a6d3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.170824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54851fef-b52c-4c8c-b3c8-bedf8a6d3386 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.171102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54851fef-b52c-4c8c-b3c8-bedf8a6d3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.171369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54851fef-b52c-4c8c-b3c8-bedf8a6d3386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.172038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54851fef-b52c-4c8c-b3c8-bedf8a6d3386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.173745 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54851fef-b52c-4c8c-b3c8-bedf8a6d3386 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.184437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1071/2104] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:29:33.188461 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010205cf-e951-41d8-9a12-3a95a13495f6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.199285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010205cf-e951-41d8-9a12-3a95a13495f6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.204595 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c70f6-fe3a-4010-ba8d-26815c7b461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.205246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c70f6-fe3a-4010-ba8d-26815c7b461b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.205511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c70f6-fe3a-4010-ba8d-26815c7b461b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.205768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c70f6-fe3a-4010-ba8d-26815c7b461b admin admin] PATH_INFO: `/v3/projects/3d54b31fa0dd48a99d9f7d5774667822/users/e7af978f18774f7fbe287aba995d6563/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.221387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c70f6-fe3a-4010-ba8d-26815c7b461b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d54b31fa0dd48a99d9f7d5774667822, user_id=e7af978f18774f7fbe287aba995d6563, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.224050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c70f6-fe3a-4010-ba8d-26815c7b461b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.239295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1034/2105] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:33 2022] PUT /identity/v3/projects/3d54b31fa0dd48a99d9f7d5774667822/users/e7af978f18774f7fbe287aba995d6563/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:33.250258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f5aa2-51a2-42de-808a-dbcbc3b1cbda None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.250569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f5aa2-51a2-42de-808a-dbcbc3b1cbda None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.250887 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f5aa2-51a2-42de-808a-dbcbc3b1cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.279365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-232f5aa2-51a2-42de-808a-dbcbc3b1cbda None None] MFA Rules not processed for user `e7af978f18774f7fbe287aba995d6563`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:33.280562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-232f5aa2-51a2-42de-808a-dbcbc3b1cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:33.346329 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1072/2106] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:33.351139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c70f6-fe3a-4010-ba8d-26815c7b461b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.419209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c70f6-fe3a-4010-ba8d-26815c7b461b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.424446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f37f88-2838-4ca1-a801-d1df32b040a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.425048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f37f88-2838-4ca1-a801-d1df32b040a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.425326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f37f88-2838-4ca1-a801-d1df32b040a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.425625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f37f88-2838-4ca1-a801-d1df32b040a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.426253 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f37f88-2838-4ca1-a801-d1df32b040a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.428178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f37f88-2838-4ca1-a801-d1df32b040a9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.457986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1035/2107] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:33 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:33.462373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f5aa2-51a2-42de-808a-dbcbc3b1cbda None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.474083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f5aa2-51a2-42de-808a-dbcbc3b1cbda None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.541929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35ae8-9e51-415d-93e3-3182423c6789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.542552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35ae8-9e51-415d-93e3-3182423c6789 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.542865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35ae8-9e51-415d-93e3-3182423c6789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.543139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35ae8-9e51-415d-93e3-3182423c6789 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.543748 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed35ae8-9e51-415d-93e3-3182423c6789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.545667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed35ae8-9e51-415d-93e3-3182423c6789 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.570170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1073/2108] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:33 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:33.574398 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f37f88-2838-4ca1-a801-d1df32b040a9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.585149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f37f88-2838-4ca1-a801-d1df32b040a9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.590582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffa4d-6b2d-4c00-afc5-1b1028bda850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.591249 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffa4d-6b2d-4c00-afc5-1b1028bda850 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.591532 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffa4d-6b2d-4c00-afc5-1b1028bda850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.591799 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffa4d-6b2d-4c00-afc5-1b1028bda850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.592442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ffa4d-6b2d-4c00-afc5-1b1028bda850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.594027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ffa4d-6b2d-4c00-afc5-1b1028bda850 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.604763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1036/2109] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:33.609218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35ae8-9e51-415d-93e3-3182423c6789 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.620073 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35ae8-9e51-415d-93e3-3182423c6789 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.625880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b795e49-d029-47e1-ab90-2603d08d594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.626544 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b795e49-d029-47e1-ab90-2603d08d594d admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.626848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b795e49-d029-47e1-ab90-2603d08d594d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.627114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b795e49-d029-47e1-ab90-2603d08d594d admin admin] PATH_INFO: `/v3/projects/546e2361cc4c4aaf98bf04b3c7248063/users/6c6bac1ad5774e74a8c975715d9fc60d/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.642699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b795e49-d029-47e1-ab90-2603d08d594d admin admin] RBAC: Authorizing `identity:create_grant(project_id=546e2361cc4c4aaf98bf04b3c7248063, user_id=6c6bac1ad5774e74a8c975715d9fc60d, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.645346 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b795e49-d029-47e1-ab90-2603d08d594d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.659890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1074/2110] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:33 2022] PUT /identity/v3/projects/546e2361cc4c4aaf98bf04b3c7248063/users/6c6bac1ad5774e74a8c975715d9fc60d/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:33.663883 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffa4d-6b2d-4c00-afc5-1b1028bda850 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.674074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffa4d-6b2d-4c00-afc5-1b1028bda850 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.682231 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:33.736076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058b118-efa8-4bae-b22c-d644ed6f25aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.736608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b118-efa8-4bae-b22c-d644ed6f25aa admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.736887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b118-efa8-4bae-b22c-d644ed6f25aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.737138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b118-efa8-4bae-b22c-d644ed6f25aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.737783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058b118-efa8-4bae-b22c-d644ed6f25aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.739447 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058b118-efa8-4bae-b22c-d644ed6f25aa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.750079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1037/2111] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:33.755944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b795e49-d029-47e1-ab90-2603d08d594d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.761715 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:33.768337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b795e49-d029-47e1-ab90-2603d08d594d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.773537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9b77-dcd3-443a-95bd-842e8fcfdb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.774189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9b77-dcd3-443a-95bd-842e8fcfdb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.774468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9b77-dcd3-443a-95bd-842e8fcfdb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.774793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9b77-dcd3-443a-95bd-842e8fcfdb63 admin admin] PATH_INFO: `/v3/projects/546e2361cc4c4aaf98bf04b3c7248063/users/6c6bac1ad5774e74a8c975715d9fc60d/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.776744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e9b77-dcd3-443a-95bd-842e8fcfdb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546e2361cc4c4aaf98bf04b3c7248063, user_id=6c6bac1ad5774e74a8c975715d9fc60d, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.779408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e9b77-dcd3-443a-95bd-842e8fcfdb63 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:33.790003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1075/2112] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:33 2022] PUT /identity/v3/projects/546e2361cc4c4aaf98bf04b3c7248063/users/6c6bac1ad5774e74a8c975715d9fc60d/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:33.800419 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b4233-486b-4cd1-a9a5-9061ae37dcee None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.800709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b4233-486b-4cd1-a9a5-9061ae37dcee None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.800964 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b4233-486b-4cd1-a9a5-9061ae37dcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.829944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4f5b4233-486b-4cd1-a9a5-9061ae37dcee None None] MFA Rules not processed for user `6c6bac1ad5774e74a8c975715d9fc60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:33.831198 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4f5b4233-486b-4cd1-a9a5-9061ae37dcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:33.901722 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1038/2113] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:33.913320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9b77-dcd3-443a-95bd-842e8fcfdb63 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:33.915436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-189e9b77-dcd3-443a-95bd-842e8fcfdb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:33.977213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e9b77-dcd3-443a-95bd-842e8fcfdb63 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:33.981327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb9f6-30c7-4a24-a5dd-1e4924163ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:33.981923 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb9f6-30c7-4a24-a5dd-1e4924163ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:33.982194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb9f6-30c7-4a24-a5dd-1e4924163ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:33.982464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb9f6-30c7-4a24-a5dd-1e4924163ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:33.992609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deb9f6-30c7-4a24-a5dd-1e4924163ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:33.993959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deb9f6-30c7-4a24-a5dd-1e4924163ad8 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:34.003817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1076/2114] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:34.083489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b4233-486b-4cd1-a9a5-9061ae37dcee None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:34.093375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b4233-486b-4cd1-a9a5-9061ae37dcee None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:34.097397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03e154-6d1f-4d00-b1bb-4eb2e4818b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:34.097999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e154-6d1f-4d00-b1bb-4eb2e4818b18 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:34.098278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e154-6d1f-4d00-b1bb-4eb2e4818b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:34.098551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e154-6d1f-4d00-b1bb-4eb2e4818b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:34.155935 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03e154-6d1f-4d00-b1bb-4eb2e4818b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:34.157459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03e154-6d1f-4d00-b1bb-4eb2e4818b18 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:34.166212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1039/2115] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:41.068525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb9f6-30c7-4a24-a5dd-1e4924163ad8 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:41.132580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb9f6-30c7-4a24-a5dd-1e4924163ad8 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:41.137629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:41.138268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:41.138546 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:41.138842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] PATH_INFO: `/v3/users/e7af978f18774f7fbe287aba995d6563` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:41.140083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7af978f18774f7fbe287aba995d6563)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:41.141997 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:41.189424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7af978f18774f7fbe287aba995d6563'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.197347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7af978f18774f7fbe287aba995d6563'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.205125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7af978f18774f7fbe287aba995d6563'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.205747 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7af978f18774f7fbe287aba995d6563'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.218573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7af978f18774f7fbe287aba995d6563'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.224795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1077/2116] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:41 2022] DELETE /identity/v3/users/e7af978f18774f7fbe287aba995d6563 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:41.229435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa87c0-184c-4d73-9157-fbaaf37bb66f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:41.229927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa87c0-184c-4d73-9157-fbaaf37bb66f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:41.230029 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa87c0-184c-4d73-9157-fbaaf37bb66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:41.250101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-eafa87c0-184c-4d73-9157-fbaaf37bb66f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:41.251333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eafa87c0-184c-4d73-9157-fbaaf37bb66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:41.277320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:41.311317 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1040/2117] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:41.321155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:41.322851 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:41.337731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:41.382959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b01b8-1c54-4a31-b1fb-764641ec24b2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:41.386945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352fee8-ae53-4fbf-bc0d-e66cdd7dd02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:41.387550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352fee8-ae53-4fbf-bc0d-e66cdd7dd02f service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:41.387829 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352fee8-ae53-4fbf-bc0d-e66cdd7dd02f service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:41.388102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352fee8-ae53-4fbf-bc0d-e66cdd7dd02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:41.397145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352fee8-ae53-4fbf-bc0d-e66cdd7dd02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:41.398575 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352fee8-ae53-4fbf-bc0d-e66cdd7dd02f service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:41.407867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1078/2118] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:41.684895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa87c0-184c-4d73-9157-fbaaf37bb66f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:41.686406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eafa87c0-184c-4d73-9157-fbaaf37bb66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:41.698612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa87c0-184c-4d73-9157-fbaaf37bb66f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:41.703260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:41.703909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:41.704191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:41.704474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] PATH_INFO: `/v3/projects/3d54b31fa0dd48a99d9f7d5774667822` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:41.705597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d54b31fa0dd48a99d9f7d5774667822)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:41.707597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:41.755807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d54b31fa0dd48a99d9f7d5774667822', 'request_id': 'req-c267787d-a0e0-4fab-bc53-1935cee2288e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.764411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d54b31fa0dd48a99d9f7d5774667822', 'request_id': 'req-c267787d-a0e0-4fab-bc53-1935cee2288e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.770280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d54b31fa0dd48a99d9f7d5774667822', 'request_id': 'req-c267787d-a0e0-4fab-bc53-1935cee2288e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.781656 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] The token cache is being invalidate because project 3d54b31fa0dd48a99d9f7d5774667822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:41.781943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.782639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.784241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1041/2119] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:41 2022] DELETE /identity/v3/projects/3d54b31fa0dd48a99d9f7d5774667822 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:41.788364 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352fee8-ae53-4fbf-bc0d-e66cdd7dd02f service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:41.798128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352fee8-ae53-4fbf-bc0d-e66cdd7dd02f service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:41.859866 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:41.860506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:41.860790 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:41.861061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] PATH_INFO: `/v3/users/6c6bac1ad5774e74a8c975715d9fc60d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:41.862212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6bac1ad5774e74a8c975715d9fc60d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:41.864221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:41.914140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6bac1ad5774e74a8c975715d9fc60d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.921942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6bac1ad5774e74a8c975715d9fc60d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.929203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6bac1ad5774e74a8c975715d9fc60d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.929796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6bac1ad5774e74a8c975715d9fc60d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.941623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4c051e2f-008c-4216-b699-ca968a11f705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6bac1ad5774e74a8c975715d9fc60d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:41.947526 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1079/2120] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:41 2022] DELETE /identity/v3/users/6c6bac1ad5774e74a8c975715d9fc60d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:42.231481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:42.232992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:42.250295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267787d-a0e0-4fab-bc53-1935cee2288e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:42.310311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:42.310996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.311273 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.311546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] PATH_INFO: `/v3/projects/546e2361cc4c4aaf98bf04b3c7248063` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.312653 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546e2361cc4c4aaf98bf04b3c7248063)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:42.314599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:42.365319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546e2361cc4c4aaf98bf04b3c7248063', 'request_id': 'req-b3aa12b9-5a76-46eb-8314-a148a857bc26'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:42.374731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546e2361cc4c4aaf98bf04b3c7248063', 'request_id': 'req-b3aa12b9-5a76-46eb-8314-a148a857bc26'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:42.376088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:42.382115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546e2361cc4c4aaf98bf04b3c7248063', 'request_id': 'req-b3aa12b9-5a76-46eb-8314-a148a857bc26'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:42.394492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] The token cache is being invalidate because project 546e2361cc4c4aaf98bf04b3c7248063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:42.394814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:42.395493 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b3aa12b9-5a76-46eb-8314-a148a857bc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:42.397120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1042/2121] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:42 2022] DELETE /identity/v3/projects/546e2361cc4c4aaf98bf04b3c7248063 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:42.402196 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfedbf8-23fd-48c7-ad12-a19fce9dea74 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.402756 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfedbf8-23fd-48c7-ad12-a19fce9dea74 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.402756 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfedbf8-23fd-48c7-ad12-a19fce9dea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.423818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3dfedbf8-23fd-48c7-ad12-a19fce9dea74 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:42.425039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3dfedbf8-23fd-48c7-ad12-a19fce9dea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:42.454525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:42.486953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1080/2122] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:42.495326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac251cf-3edd-4a69-80e4-e96126257550 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.495594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac251cf-3edd-4a69-80e4-e96126257550 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.495882 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac251cf-3edd-4a69-80e4-e96126257550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.516913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-aac251cf-3edd-4a69-80e4-e96126257550 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:42.518162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aac251cf-3edd-4a69-80e4-e96126257550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:42.528275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1043/2123] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:42.532470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfedbf8-23fd-48c7-ad12-a19fce9dea74 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:42.542754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfedbf8-23fd-48c7-ad12-a19fce9dea74 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:42.548195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da333538-f72c-4720-b444-929c8cce25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:42.548820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da333538-f72c-4720-b444-929c8cce25d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.549115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da333538-f72c-4720-b444-929c8cce25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.549411 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da333538-f72c-4720-b444-929c8cce25d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.550043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da333538-f72c-4720-b444-929c8cce25d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:42.550396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da333538-f72c-4720-b444-929c8cce25d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:42.552030 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da333538-f72c-4720-b444-929c8cce25d0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:42.565116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1081/2124] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:29:42.570065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac251cf-3edd-4a69-80e4-e96126257550 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:42.579700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac251cf-3edd-4a69-80e4-e96126257550 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:42.584757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079320ed-420e-4d83-92e9-d151f2cf4167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:42.585474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079320ed-420e-4d83-92e9-d151f2cf4167 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.585919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079320ed-420e-4d83-92e9-d151f2cf4167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.586202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079320ed-420e-4d83-92e9-d151f2cf4167 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.586900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079320ed-420e-4d83-92e9-d151f2cf4167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:42.589131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079320ed-420e-4d83-92e9-d151f2cf4167 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:42.626181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1044/2125] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:42 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:42.627409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da333538-f72c-4720-b444-929c8cce25d0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:42.638459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da333538-f72c-4720-b444-929c8cce25d0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:42.697277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4a4d2-2858-4ecf-b277-3790e2fd1dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:42.697900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4a4d2-2858-4ecf-b277-3790e2fd1dbe admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.698179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4a4d2-2858-4ecf-b277-3790e2fd1dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.698451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4a4d2-2858-4ecf-b277-3790e2fd1dbe admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.699132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4a4d2-2858-4ecf-b277-3790e2fd1dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:42.701032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4a4d2-2858-4ecf-b277-3790e2fd1dbe admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:42.724859 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1082/2126] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:42 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:42.726124 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079320ed-420e-4d83-92e9-d151f2cf4167 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:42.736535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079320ed-420e-4d83-92e9-d151f2cf4167 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:42.741785 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede11c-24ed-4dec-bf9e-657e9d2173c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:42.742846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede11c-24ed-4dec-bf9e-657e9d2173c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.743188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede11c-24ed-4dec-bf9e-657e9d2173c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.743542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ede11c-24ed-4dec-bf9e-657e9d2173c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.744261 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ede11c-24ed-4dec-bf9e-657e9d2173c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:42.746007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ede11c-24ed-4dec-bf9e-657e9d2173c1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:42.756626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1045/2127] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:42.762621 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4a4d2-2858-4ecf-b277-3790e2fd1dbe admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:42.775460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4a4d2-2858-4ecf-b277-3790e2fd1dbe admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:42.780403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bd9e1-3c73-427d-871a-f5305cf07db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:42.781016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd9e1-3c73-427d-871a-f5305cf07db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.781295 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd9e1-3c73-427d-871a-f5305cf07db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.781691 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bd9e1-3c73-427d-871a-f5305cf07db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.782347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bd9e1-3c73-427d-871a-f5305cf07db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:42.783976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bd9e1-3c73-427d-871a-f5305cf07db7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:42.799047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1083/2128] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:42.800358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede11c-24ed-4dec-bf9e-657e9d2173c1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:42.811142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ede11c-24ed-4dec-bf9e-657e9d2173c1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:42.815887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b073f-4add-44b7-95ef-b1fab69873e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:42.816645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b073f-4add-44b7-95ef-b1fab69873e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.816963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b073f-4add-44b7-95ef-b1fab69873e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.817296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b073f-4add-44b7-95ef-b1fab69873e8 admin admin] PATH_INFO: `/v3/projects/02ecd9fb6f0846d4afef4e669b01e9b6/users/e5f10cad10e643e2ae9333bdb293ec60/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.839267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b073f-4add-44b7-95ef-b1fab69873e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ecd9fb6f0846d4afef4e669b01e9b6, user_id=e5f10cad10e643e2ae9333bdb293ec60, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:42.842088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b073f-4add-44b7-95ef-b1fab69873e8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:42.856259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1046/2129] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:42 2022] PUT /identity/v3/projects/02ecd9fb6f0846d4afef4e669b01e9b6/users/e5f10cad10e643e2ae9333bdb293ec60/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:42.866814 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57de41b-6d89-4174-a9b2-56510d6bebb4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:42.867469 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57de41b-6d89-4174-a9b2-56510d6bebb4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:42.867744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57de41b-6d89-4174-a9b2-56510d6bebb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:42.898049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b57de41b-6d89-4174-a9b2-56510d6bebb4 None None] MFA Rules not processed for user `e5f10cad10e643e2ae9333bdb293ec60`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:42.899316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b57de41b-6d89-4174-a9b2-56510d6bebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:42.965423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1084/2130] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:42.969797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b073f-4add-44b7-95ef-b1fab69873e8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:43.034280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b073f-4add-44b7-95ef-b1fab69873e8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:43.039209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e17cdc-ff15-4d0d-a905-2473f3d10699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:43.039822 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e17cdc-ff15-4d0d-a905-2473f3d10699 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:43.040099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e17cdc-ff15-4d0d-a905-2473f3d10699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:43.040370 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e17cdc-ff15-4d0d-a905-2473f3d10699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:43.041011 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e17cdc-ff15-4d0d-a905-2473f3d10699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:43.042967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e17cdc-ff15-4d0d-a905-2473f3d10699 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:43.070988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1047/2131] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:42 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:43.075383 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57de41b-6d89-4174-a9b2-56510d6bebb4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:43.086979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57de41b-6d89-4174-a9b2-56510d6bebb4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:43.115257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:43.147434 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784ec1f-c2ed-4cb1-90a2-b37aa018db2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:43.148065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784ec1f-c2ed-4cb1-90a2-b37aa018db2a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:43.148322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784ec1f-c2ed-4cb1-90a2-b37aa018db2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:43.148589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784ec1f-c2ed-4cb1-90a2-b37aa018db2a admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:43.149229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784ec1f-c2ed-4cb1-90a2-b37aa018db2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:43.151192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784ec1f-c2ed-4cb1-90a2-b37aa018db2a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:43.173926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1085/2132] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:43 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:43.178209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e17cdc-ff15-4d0d-a905-2473f3d10699 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:43.189931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e17cdc-ff15-4d0d-a905-2473f3d10699 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:43.195412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd44805-7894-4f62-8841-f41b65b44218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:43.196008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd44805-7894-4f62-8841-f41b65b44218 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:43.196322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd44805-7894-4f62-8841-f41b65b44218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:43.196591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd44805-7894-4f62-8841-f41b65b44218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:43.197241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd44805-7894-4f62-8841-f41b65b44218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:43.198892 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd44805-7894-4f62-8841-f41b65b44218 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:43.209676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1048/2133] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:29:43.213832 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784ec1f-c2ed-4cb1-90a2-b37aa018db2a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:43.224065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784ec1f-c2ed-4cb1-90a2-b37aa018db2a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:43.229174 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e3211-a5a0-4720-bf73-1447b9645407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:43.229828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e3211-a5a0-4720-bf73-1447b9645407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:43.230104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e3211-a5a0-4720-bf73-1447b9645407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:43.230374 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e3211-a5a0-4720-bf73-1447b9645407 admin admin] PATH_INFO: `/v3/projects/01e0a8083e7f43ea9a196142a8595682/users/f145ae5181d5405aa20ec06e6624f862/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:43.245651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e3211-a5a0-4720-bf73-1447b9645407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e0a8083e7f43ea9a196142a8595682, user_id=f145ae5181d5405aa20ec06e6624f862, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:43.248320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e3211-a5a0-4720-bf73-1447b9645407 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:43.262423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1086/2134] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:43 2022] PUT /identity/v3/projects/01e0a8083e7f43ea9a196142a8595682/users/f145ae5181d5405aa20ec06e6624f862/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:43.266380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd44805-7894-4f62-8841-f41b65b44218 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:43.276435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd44805-7894-4f62-8841-f41b65b44218 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:43.326810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:43.335083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44c06f-85c9-4117-9f22-96a9084e2850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:43.335875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44c06f-85c9-4117-9f22-96a9084e2850 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:43.336371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44c06f-85c9-4117-9f22-96a9084e2850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:43.336710 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44c06f-85c9-4117-9f22-96a9084e2850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:43.337408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44c06f-85c9-4117-9f22-96a9084e2850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:43.339345 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44c06f-85c9-4117-9f22-96a9084e2850 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:43.349225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1049/2135] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:29:43.353586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e3211-a5a0-4720-bf73-1447b9645407 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:43.364586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e3211-a5a0-4720-bf73-1447b9645407 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:43.370871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c521d-a6a5-4bcf-a14d-93f854157e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:43.371534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c521d-a6a5-4bcf-a14d-93f854157e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:43.371818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c521d-a6a5-4bcf-a14d-93f854157e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:43.372078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c521d-a6a5-4bcf-a14d-93f854157e11 admin admin] PATH_INFO: `/v3/projects/01e0a8083e7f43ea9a196142a8595682/users/f145ae5181d5405aa20ec06e6624f862/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:43.374215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c521d-a6a5-4bcf-a14d-93f854157e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e0a8083e7f43ea9a196142a8595682, user_id=f145ae5181d5405aa20ec06e6624f862, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:43.376898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c521d-a6a5-4bcf-a14d-93f854157e11 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:43.387759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1087/2136] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:43 2022] PUT /identity/v3/projects/01e0a8083e7f43ea9a196142a8595682/users/f145ae5181d5405aa20ec06e6624f862/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:43.399011 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc3c5-00e9-4115-9df1-324d0a1b9157 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:43.399371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc3c5-00e9-4115-9df1-324d0a1b9157 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:43.399715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc3c5-00e9-4115-9df1-324d0a1b9157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:43.429304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ff6cc3c5-00e9-4115-9df1-324d0a1b9157 None None] MFA Rules not processed for user `f145ae5181d5405aa20ec06e6624f862`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:43.430511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ff6cc3c5-00e9-4115-9df1-324d0a1b9157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:43.511141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1050/2137] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:43.523166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c521d-a6a5-4bcf-a14d-93f854157e11 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:43.525124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-675c521d-a6a5-4bcf-a14d-93f854157e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:43.584655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c521d-a6a5-4bcf-a14d-93f854157e11 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:43.588680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262da185-4a6a-4e1a-9461-c2a03827bd17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:43.589417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da185-4a6a-4e1a-9461-c2a03827bd17 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:43.589699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da185-4a6a-4e1a-9461-c2a03827bd17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:43.589965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da185-4a6a-4e1a-9461-c2a03827bd17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:43.600897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262da185-4a6a-4e1a-9461-c2a03827bd17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:43.602327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262da185-4a6a-4e1a-9461-c2a03827bd17 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:43.612035 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1088/2138] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:43.694409 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cc3c5-00e9-4115-9df1-324d0a1b9157 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:43.704562 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cc3c5-00e9-4115-9df1-324d0a1b9157 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:43.708611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ef76d-ab20-493a-8510-6f020a06f995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:43.709219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ef76d-ab20-493a-8510-6f020a06f995 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:43.709494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ef76d-ab20-493a-8510-6f020a06f995 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:43.709766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ef76d-ab20-493a-8510-6f020a06f995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:43.767002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ef76d-ab20-493a-8510-6f020a06f995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:43.768351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ef76d-ab20-493a-8510-6f020a06f995 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:43.777337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1051/2139] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:46.544353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262da185-4a6a-4e1a-9461-c2a03827bd17 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:46.612253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262da185-4a6a-4e1a-9461-c2a03827bd17 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:46.617907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:46.618571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:46.618983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:46.619488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] PATH_INFO: `/v3/users/e5f10cad10e643e2ae9333bdb293ec60` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:46.620769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f10cad10e643e2ae9333bdb293ec60)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:46.622910 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:46.654208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:46.673793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f10cad10e643e2ae9333bdb293ec60'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:46.681772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f10cad10e643e2ae9333bdb293ec60'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:46.690028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f10cad10e643e2ae9333bdb293ec60'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:46.690777 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f10cad10e643e2ae9333bdb293ec60'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:46.703002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f10cad10e643e2ae9333bdb293ec60'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:46.709163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1089/2140] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:46 2022] DELETE /identity/v3/users/e5f10cad10e643e2ae9333bdb293ec60 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:46.713690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048709e-9a1a-4ff3-89ba-98c0654fd207 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:46.714189 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048709e-9a1a-4ff3-89ba-98c0654fd207 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:46.714297 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048709e-9a1a-4ff3-89ba-98c0654fd207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:46.734050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5048709e-9a1a-4ff3-89ba-98c0654fd207 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:46.735382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5048709e-9a1a-4ff3-89ba-98c0654fd207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:46.795001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1052/2141] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:46.804789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:46.806447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:46.874130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0041f-9d6c-431f-be6c-ed09634c70b8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:46.878003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cff07-3f03-4c06-8c19-d63aa522ef35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:46.878797 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cff07-3f03-4c06-8c19-d63aa522ef35 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:46.879084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cff07-3f03-4c06-8c19-d63aa522ef35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:46.879352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cff07-3f03-4c06-8c19-d63aa522ef35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:46.889264 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cff07-3f03-4c06-8c19-d63aa522ef35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:46.890831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cff07-3f03-4c06-8c19-d63aa522ef35 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:46.901268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1090/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:47.180017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048709e-9a1a-4ff3-89ba-98c0654fd207 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:47.181633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5048709e-9a1a-4ff3-89ba-98c0654fd207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:47.194709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048709e-9a1a-4ff3-89ba-98c0654fd207 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:47.200030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:47.200937 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:47.201389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:47.201670 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] PATH_INFO: `/v3/projects/02ecd9fb6f0846d4afef4e669b01e9b6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:47.203641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ecd9fb6f0846d4afef4e669b01e9b6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:47.205718 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:47.217184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:47.255407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ecd9fb6f0846d4afef4e669b01e9b6', 'request_id': 'req-9bd65358-84cd-4ed9-8e8c-e11d70961885'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.263641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ecd9fb6f0846d4afef4e669b01e9b6', 'request_id': 'req-9bd65358-84cd-4ed9-8e8c-e11d70961885'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.269606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ecd9fb6f0846d4afef4e669b01e9b6', 'request_id': 'req-9bd65358-84cd-4ed9-8e8c-e11d70961885'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.281307 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] The token cache is being invalidate because project 02ecd9fb6f0846d4afef4e669b01e9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:47.281594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.282264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.283844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1053/2143] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:47 2022] DELETE /identity/v3/projects/02ecd9fb6f0846d4afef4e669b01e9b6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:47.288498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cff07-3f03-4c06-8c19-d63aa522ef35 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:47.298451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cff07-3f03-4c06-8c19-d63aa522ef35 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:47.358042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:47.358794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:47.359003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:47.359278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] PATH_INFO: `/v3/users/f145ae5181d5405aa20ec06e6624f862` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:47.360413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f145ae5181d5405aa20ec06e6624f862)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:47.362459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:47.409033 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f145ae5181d5405aa20ec06e6624f862'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.410640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:47.417517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f145ae5181d5405aa20ec06e6624f862'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.427111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f145ae5181d5405aa20ec06e6624f862'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.427818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f145ae5181d5405aa20ec06e6624f862'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.441932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-176bcf68-51fa-4faa-81db-1ac11d651083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f145ae5181d5405aa20ec06e6624f862'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.448169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1091/2144] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:47 2022] DELETE /identity/v3/users/f145ae5181d5405aa20ec06e6624f862 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:47.737689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:47.739295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:47.753346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd65358-84cd-4ed9-8e8c-e11d70961885 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:47.812367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:47.813020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:47.813325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:47.813605 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] PATH_INFO: `/v3/projects/01e0a8083e7f43ea9a196142a8595682` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:47.814810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e0a8083e7f43ea9a196142a8595682)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:47.816744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:47.866459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e0a8083e7f43ea9a196142a8595682', 'request_id': 'req-73232b23-1a65-4597-bae0-b7b34d282ab1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.875247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e0a8083e7f43ea9a196142a8595682', 'request_id': 'req-73232b23-1a65-4597-bae0-b7b34d282ab1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.881171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e0a8083e7f43ea9a196142a8595682', 'request_id': 'req-73232b23-1a65-4597-bae0-b7b34d282ab1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.892422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] The token cache is being invalidate because project 01e0a8083e7f43ea9a196142a8595682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:47.892699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.893326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73232b23-1a65-4597-bae0-b7b34d282ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:47.894954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1054/2145] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:47 2022] DELETE /identity/v3/projects/01e0a8083e7f43ea9a196142a8595682 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:47.899928 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e4db-62ee-48f7-8233-ba19b8c6e7a9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:47.900453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e4db-62ee-48f7-8233-ba19b8c6e7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:47.900453 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e4db-62ee-48f7-8233-ba19b8c6e7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:47.921101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8640e4db-62ee-48f7-8233-ba19b8c6e7a9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:47.922333 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8640e4db-62ee-48f7-8233-ba19b8c6e7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:47.982352 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1092/2146] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:47.990457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d1655-298c-43b0-a8f3-7023b1935ad8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:47.990775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d1655-298c-43b0-a8f3-7023b1935ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:47.991074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d1655-298c-43b0-a8f3-7023b1935ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.013846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ac4d1655-298c-43b0-a8f3-7023b1935ad8 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:48.015110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ac4d1655-298c-43b0-a8f3-7023b1935ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:48.024549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1055/2147] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:48.029078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640e4db-62ee-48f7-8233-ba19b8c6e7a9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.039306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640e4db-62ee-48f7-8233-ba19b8c6e7a9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.044541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104e35-40c5-4c98-a925-8b2160d25024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.045136 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104e35-40c5-4c98-a925-8b2160d25024 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.045412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104e35-40c5-4c98-a925-8b2160d25024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.045663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104e35-40c5-4c98-a925-8b2160d25024 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.046335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104e35-40c5-4c98-a925-8b2160d25024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:48.046626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104e35-40c5-4c98-a925-8b2160d25024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.048236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4104e35-40c5-4c98-a925-8b2160d25024 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.060444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1093/2148] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:29:48.064754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d1655-298c-43b0-a8f3-7023b1935ad8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.074559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d1655-298c-43b0-a8f3-7023b1935ad8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.079806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118039-ad9e-4787-952f-6549dda44c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.080399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118039-ad9e-4787-952f-6549dda44c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.080674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118039-ad9e-4787-952f-6549dda44c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.080942 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118039-ad9e-4787-952f-6549dda44c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.081609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af118039-ad9e-4787-952f-6549dda44c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.083565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af118039-ad9e-4787-952f-6549dda44c8c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.107955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:48.117286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1056/2149] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:48 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:48.121140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104e35-40c5-4c98-a925-8b2160d25024 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.131401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104e35-40c5-4c98-a925-8b2160d25024 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.189078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ace26d-3ca6-49eb-a6c8-14bfc80d8f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.189697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ace26d-3ca6-49eb-a6c8-14bfc80d8f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.189973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ace26d-3ca6-49eb-a6c8-14bfc80d8f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.190228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ace26d-3ca6-49eb-a6c8-14bfc80d8f0c admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.190991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ace26d-3ca6-49eb-a6c8-14bfc80d8f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.192921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ace26d-3ca6-49eb-a6c8-14bfc80d8f0c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.218643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1094/2150] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:48 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:48.223113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118039-ad9e-4787-952f-6549dda44c8c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.235566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118039-ad9e-4787-952f-6549dda44c8c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.246583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a67ea-285f-44a0-a324-308a20697037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.247311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a67ea-285f-44a0-a324-308a20697037 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.247659 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a67ea-285f-44a0-a324-308a20697037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.248010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a67ea-285f-44a0-a324-308a20697037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.248734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a67ea-285f-44a0-a324-308a20697037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.250538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a67ea-285f-44a0-a324-308a20697037 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.265128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1057/2151] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:48.266469 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ace26d-3ca6-49eb-a6c8-14bfc80d8f0c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.278879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ace26d-3ca6-49eb-a6c8-14bfc80d8f0c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.282218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872adfe-10d3-4038-8d9b-4fef043df945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.282878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872adfe-10d3-4038-8d9b-4fef043df945 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.283160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872adfe-10d3-4038-8d9b-4fef043df945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.284014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872adfe-10d3-4038-8d9b-4fef043df945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.284800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872adfe-10d3-4038-8d9b-4fef043df945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.286385 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872adfe-10d3-4038-8d9b-4fef043df945 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.297948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1095/2152] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:48.302270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a67ea-285f-44a0-a324-308a20697037 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.312604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a67ea-285f-44a0-a324-308a20697037 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.317312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6b088-dd83-4a13-b062-03f6da563500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.318058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6b088-dd83-4a13-b062-03f6da563500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.318377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6b088-dd83-4a13-b062-03f6da563500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.318701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6b088-dd83-4a13-b062-03f6da563500 admin admin] PATH_INFO: `/v3/projects/2a3a09159c694a439fae3af591bd2d4e/users/d29dfca946cd49e3b62d7eaea3c15452/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.335592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6b088-dd83-4a13-b062-03f6da563500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3a09159c694a439fae3af591bd2d4e, user_id=d29dfca946cd49e3b62d7eaea3c15452, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.338193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6b088-dd83-4a13-b062-03f6da563500 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.353118 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1058/2153] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:48 2022] PUT /identity/v3/projects/2a3a09159c694a439fae3af591bd2d4e/users/d29dfca946cd49e3b62d7eaea3c15452/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:48.363676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff001c-978d-42b1-aab0-d00a69ebfe1e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.363964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff001c-978d-42b1-aab0-d00a69ebfe1e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.364240 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff001c-978d-42b1-aab0-d00a69ebfe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.392600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-43ff001c-978d-42b1-aab0-d00a69ebfe1e None None] MFA Rules not processed for user `d29dfca946cd49e3b62d7eaea3c15452`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:48.393849 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-43ff001c-978d-42b1-aab0-d00a69ebfe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:48.411916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:48.462350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1096/2154] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:48.467031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6b088-dd83-4a13-b062-03f6da563500 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.529931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6b088-dd83-4a13-b062-03f6da563500 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.535190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5bb16-9de4-44d4-8e65-43bff85b3d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.535806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bb16-9de4-44d4-8e65-43bff85b3d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.536078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bb16-9de4-44d4-8e65-43bff85b3d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.536343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5bb16-9de4-44d4-8e65-43bff85b3d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.536974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5bb16-9de4-44d4-8e65-43bff85b3d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.538900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5bb16-9de4-44d4-8e65-43bff85b3d75 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.573983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1059/2155] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:48 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:48.578391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff001c-978d-42b1-aab0-d00a69ebfe1e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.590878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff001c-978d-42b1-aab0-d00a69ebfe1e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.650320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068cecd-4182-466b-b870-92af0a2bfae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.650970 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068cecd-4182-466b-b870-92af0a2bfae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.651250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068cecd-4182-466b-b870-92af0a2bfae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.651515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068cecd-4182-466b-b870-92af0a2bfae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.652151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068cecd-4182-466b-b870-92af0a2bfae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.654089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068cecd-4182-466b-b870-92af0a2bfae8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.676879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1097/2156] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:48 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:48.680959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5bb16-9de4-44d4-8e65-43bff85b3d75 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.691414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5bb16-9de4-44d4-8e65-43bff85b3d75 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.697019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15c0be-1b8a-4122-ac7b-06c6bc4d3e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.697636 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15c0be-1b8a-4122-ac7b-06c6bc4d3e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.697907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15c0be-1b8a-4122-ac7b-06c6bc4d3e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.698178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15c0be-1b8a-4122-ac7b-06c6bc4d3e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.698862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15c0be-1b8a-4122-ac7b-06c6bc4d3e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.700467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15c0be-1b8a-4122-ac7b-06c6bc4d3e9d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.711565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1060/2157] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:48.715750 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068cecd-4182-466b-b870-92af0a2bfae8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.726061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068cecd-4182-466b-b870-92af0a2bfae8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.731285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5d49d-f047-4bd5-a4a0-c21c8b7a3e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.732014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d49d-f047-4bd5-a4a0-c21c8b7a3e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.732322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d49d-f047-4bd5-a4a0-c21c8b7a3e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.732631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d49d-f047-4bd5-a4a0-c21c8b7a3e1c admin admin] PATH_INFO: `/v3/projects/e7356ab11b4148239121cc01ee4147fc/users/7b3cdc131b5542f9a8f26ca3bc3b154e/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.748602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5d49d-f047-4bd5-a4a0-c21c8b7a3e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7356ab11b4148239121cc01ee4147fc, user_id=7b3cdc131b5542f9a8f26ca3bc3b154e, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.751358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5d49d-f047-4bd5-a4a0-c21c8b7a3e1c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.766478 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1098/2158] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:48 2022] PUT /identity/v3/projects/e7356ab11b4148239121cc01ee4147fc/users/7b3cdc131b5542f9a8f26ca3bc3b154e/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:48.770661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15c0be-1b8a-4122-ac7b-06c6bc4d3e9d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.781226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15c0be-1b8a-4122-ac7b-06c6bc4d3e9d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.841800 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0bb22-eb4c-41ce-9c04-607f1bce4c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.842518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0bb22-eb4c-41ce-9c04-607f1bce4c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.842900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0bb22-eb4c-41ce-9c04-607f1bce4c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.843248 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0bb22-eb4c-41ce-9c04-607f1bce4c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.843895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0bb22-eb4c-41ce-9c04-607f1bce4c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.845458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0bb22-eb4c-41ce-9c04-607f1bce4c27 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.855863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1061/2159] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:48.860208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5d49d-f047-4bd5-a4a0-c21c8b7a3e1c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:48.871234 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5d49d-f047-4bd5-a4a0-c21c8b7a3e1c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:48.876117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe480b2-5ca1-4f6a-9798-4c755531ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:48.876770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe480b2-5ca1-4f6a-9798-4c755531ae7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.877046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe480b2-5ca1-4f6a-9798-4c755531ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.877316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe480b2-5ca1-4f6a-9798-4c755531ae7a admin admin] PATH_INFO: `/v3/projects/e7356ab11b4148239121cc01ee4147fc/users/7b3cdc131b5542f9a8f26ca3bc3b154e/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.879369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe480b2-5ca1-4f6a-9798-4c755531ae7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7356ab11b4148239121cc01ee4147fc, user_id=7b3cdc131b5542f9a8f26ca3bc3b154e, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:48.881972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe480b2-5ca1-4f6a-9798-4c755531ae7a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:48.892398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1099/2160] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:48 2022] PUT /identity/v3/projects/e7356ab11b4148239121cc01ee4147fc/users/7b3cdc131b5542f9a8f26ca3bc3b154e/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:48.903830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2485ca-8d8a-4d5b-bca5-722ac6114888 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:48.904106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2485ca-8d8a-4d5b-bca5-722ac6114888 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:48.904387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2485ca-8d8a-4d5b-bca5-722ac6114888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:48.944497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fe2485ca-8d8a-4d5b-bca5-722ac6114888 None None] MFA Rules not processed for user `7b3cdc131b5542f9a8f26ca3bc3b154e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:48.945754 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fe2485ca-8d8a-4d5b-bca5-722ac6114888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:48.971146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:49.016330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1062/2161] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:49.028011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe480b2-5ca1-4f6a-9798-4c755531ae7a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:49.030076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2fe480b2-5ca1-4f6a-9798-4c755531ae7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:49.091682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe480b2-5ca1-4f6a-9798-4c755531ae7a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:49.095486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e9c69-c3e0-45ae-8658-0f988516973f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:49.096118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e9c69-c3e0-45ae-8658-0f988516973f service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:49.096377 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e9c69-c3e0-45ae-8658-0f988516973f service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:49.096642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e9c69-c3e0-45ae-8658-0f988516973f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:49.106209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e9c69-c3e0-45ae-8658-0f988516973f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:49.107669 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e9c69-c3e0-45ae-8658-0f988516973f service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:49.117760 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1100/2162] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:49.163798 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2485ca-8d8a-4d5b-bca5-722ac6114888 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:49.165447 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fe2485ca-8d8a-4d5b-bca5-722ac6114888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:49.178665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2485ca-8d8a-4d5b-bca5-722ac6114888 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:49.182992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f46d14-180e-4d87-b590-1a0341d0e4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:49.183597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f46d14-180e-4d87-b590-1a0341d0e4ae service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:49.183874 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f46d14-180e-4d87-b590-1a0341d0e4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:49.184123 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f46d14-180e-4d87-b590-1a0341d0e4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:49.244062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f46d14-180e-4d87-b590-1a0341d0e4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:49.245511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f46d14-180e-4d87-b590-1a0341d0e4ae service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:49.254530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1063/2163] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:49.501707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e9c69-c3e0-45ae-8658-0f988516973f service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:49.503042 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1a4e9c69-c3e0-45ae-8658-0f988516973f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:49.522937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:49.573837 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e9c69-c3e0-45ae-8658-0f988516973f service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:49.577500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49baa02-619a-4e29-91d8-0d6365f22df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:49.578193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49baa02-619a-4e29-91d8-0d6365f22df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:49.578479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49baa02-619a-4e29-91d8-0d6365f22df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:49.578795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49baa02-619a-4e29-91d8-0d6365f22df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:49.580569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e49baa02-619a-4e29-91d8-0d6365f22df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:49.644802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49baa02-619a-4e29-91d8-0d6365f22df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:49.646154 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49baa02-619a-4e29-91d8-0d6365f22df6 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:49.655929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1101/2164] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:52.738560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f46d14-180e-4d87-b590-1a0341d0e4ae service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:52.750731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f46d14-180e-4d87-b590-1a0341d0e4ae service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:52.756408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:52.757040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:52.757321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:52.757591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] PATH_INFO: `/v3/users/d29dfca946cd49e3b62d7eaea3c15452` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:52.758780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29dfca946cd49e3b62d7eaea3c15452)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:52.760750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:52.863421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29dfca946cd49e3b62d7eaea3c15452'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:52.872269 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29dfca946cd49e3b62d7eaea3c15452'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:52.886964 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29dfca946cd49e3b62d7eaea3c15452'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:52.896240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29dfca946cd49e3b62d7eaea3c15452'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:52.897050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29dfca946cd49e3b62d7eaea3c15452'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:52.906254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1064/2165] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:52 2022] DELETE /identity/v3/users/d29dfca946cd49e3b62d7eaea3c15452 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:52.909082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078fe5-4fb0-480c-a32a-b591ccdd3833 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:52.909552 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078fe5-4fb0-480c-a32a-b591ccdd3833 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:52.909683 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078fe5-4fb0-480c-a32a-b591ccdd3833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:52.936651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-52078fe5-4fb0-480c-a32a-b591ccdd3833 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:52.937964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-52078fe5-4fb0-480c-a32a-b591ccdd3833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:53.008667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1102/2166] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:53.019021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:53.020385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:53.061925 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:53.104833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27ba6b-6ad5-45e5-8c67-b960b3fdccd1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:53.110093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291399c-6943-4f4f-b774-c3fad6708966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:53.110862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291399c-6943-4f4f-b774-c3fad6708966 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.111022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291399c-6943-4f4f-b774-c3fad6708966 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.111293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291399c-6943-4f4f-b774-c3fad6708966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.121140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291399c-6943-4f4f-b774-c3fad6708966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:53.122567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291399c-6943-4f4f-b774-c3fad6708966 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:53.132314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1065/2167] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:53.165900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078fe5-4fb0-480c-a32a-b591ccdd3833 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:53.167378 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-52078fe5-4fb0-480c-a32a-b591ccdd3833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:53.180023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078fe5-4fb0-480c-a32a-b591ccdd3833 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:53.185149 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:53.185878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.186162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.186436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] PATH_INFO: `/v3/users/c37589330ceb4193a7a504600b4ced84` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.187635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37589330ceb4193a7a504600b4ced84)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:53.189786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:53.239911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37589330ceb4193a7a504600b4ced84'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.249427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37589330ceb4193a7a504600b4ced84'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.255063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:53.257101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37589330ceb4193a7a504600b4ced84'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.257775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37589330ceb4193a7a504600b4ced84'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.271737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37589330ceb4193a7a504600b4ced84'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.278095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1103/2168] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:53 2022] DELETE /identity/v3/users/c37589330ceb4193a7a504600b4ced84 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:53.416438 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291399c-6943-4f4f-b774-c3fad6708966 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:53.418094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a291399c-6943-4f4f-b774-c3fad6708966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:53.431948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291399c-6943-4f4f-b774-c3fad6708966 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:53.465229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:53.466889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:53.501024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:53.501673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.501952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.502226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] PATH_INFO: `/v3/projects/2a3a09159c694a439fae3af591bd2d4e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.503646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a3a09159c694a439fae3af591bd2d4e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:53.505541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:53.538281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffee40a-4740-4379-9d18-e606fdc52337 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:53.543618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:53.544360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.544637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.544916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] PATH_INFO: `/v3/projects/a41e52f4681f4049b157afa5dac82b21` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.546052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41e52f4681f4049b157afa5dac82b21)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:53.548162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:53.565225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a3a09159c694a439fae3af591bd2d4e', 'request_id': 'req-21a459f2-a943-4cba-b3ad-03f0c817d120'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.574478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a3a09159c694a439fae3af591bd2d4e', 'request_id': 'req-21a459f2-a943-4cba-b3ad-03f0c817d120'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.580930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a3a09159c694a439fae3af591bd2d4e', 'request_id': 'req-21a459f2-a943-4cba-b3ad-03f0c817d120'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.593138 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] The token cache is being invalidate because project 2a3a09159c694a439fae3af591bd2d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:53.593485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.594136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.595941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1066/2169] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:53 2022] DELETE /identity/v3/projects/2a3a09159c694a439fae3af591bd2d4e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:53.599054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41e52f4681f4049b157afa5dac82b21', 'request_id': 'req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.599827 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:53.601244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:53.604692 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41e52f4681f4049b157afa5dac82b21', 'request_id': 'req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.611078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41e52f4681f4049b157afa5dac82b21', 'request_id': 'req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.626105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] The token cache is being invalidate because project a41e52f4681f4049b157afa5dac82b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:53.626603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.627410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dd8680b7-1640-446c-af7e-8dcbc3ee0e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.628974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1104/2170] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:53 2022] DELETE /identity/v3/projects/a41e52f4681f4049b157afa5dac82b21 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:53.633862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804cf81-b876-4693-8b85-94727b3b32cc None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.634149 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804cf81-b876-4693-8b85-94727b3b32cc None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.634432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804cf81-b876-4693-8b85-94727b3b32cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.654759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c804cf81-b876-4693-8b85-94727b3b32cc None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:53.655929 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c804cf81-b876-4693-8b85-94727b3b32cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:53.667761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a459f2-a943-4cba-b3ad-03f0c817d120 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:53.675635 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:53.717783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1105/2171] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:53.726696 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312bf2e-903e-4538-96c7-56c05a8c2d9a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.727008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312bf2e-903e-4538-96c7-56c05a8c2d9a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.727260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:53.727388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312bf2e-903e-4538-96c7-56c05a8c2d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.727904 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.728178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.728444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] PATH_INFO: `/v3/users/7b3cdc131b5542f9a8f26ca3bc3b154e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.729686 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3cdc131b5542f9a8f26ca3bc3b154e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:53.731773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:53.747462 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9312bf2e-903e-4538-96c7-56c05a8c2d9a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:53.748635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9312bf2e-903e-4538-96c7-56c05a8c2d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:53.757260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1106/2172] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:53.761996 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312bf2e-903e-4538-96c7-56c05a8c2d9a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:53.766260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:53.772787 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312bf2e-903e-4538-96c7-56c05a8c2d9a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:53.778879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057e018-fd03-4dfd-a809-b869bb773442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:53.779502 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057e018-fd03-4dfd-a809-b869bb773442 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.779782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057e018-fd03-4dfd-a809-b869bb773442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.779880 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3cdc131b5542f9a8f26ca3bc3b154e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.780347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057e018-fd03-4dfd-a809-b869bb773442 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.780676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057e018-fd03-4dfd-a809-b869bb773442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:53.780981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057e018-fd03-4dfd-a809-b869bb773442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:53.782681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057e018-fd03-4dfd-a809-b869bb773442 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:53.787099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3cdc131b5542f9a8f26ca3bc3b154e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.794980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1107/2173] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:29:53.799301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3cdc131b5542f9a8f26ca3bc3b154e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.799431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057e018-fd03-4dfd-a809-b869bb773442 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:53.807705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3cdc131b5542f9a8f26ca3bc3b154e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.808383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3cdc131b5542f9a8f26ca3bc3b154e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:53.809269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057e018-fd03-4dfd-a809-b869bb773442 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:53.813901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a5f9-5b7a-4c47-bb9f-337905226ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:53.814664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1067/2174] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:53 2022] DELETE /identity/v3/users/7b3cdc131b5542f9a8f26ca3bc3b154e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:53.814831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a5f9-5b7a-4c47-bb9f-337905226ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.814831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a5f9-5b7a-4c47-bb9f-337905226ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.815039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960a5f9-5b7a-4c47-bb9f-337905226ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.815699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a5f9-5b7a-4c47-bb9f-337905226ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:53.817604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960a5f9-5b7a-4c47-bb9f-337905226ce5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:53.858532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1108/2175] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:53 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:53.859579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:53.861026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:53.931396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a425aef-e973-4f15-969c-f1faa4c7f01d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:53.969305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:53.996602 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaf82a-bf9d-4755-b0c1-680d1dfab466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:53.997233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaf82a-bf9d-4755-b0c1-680d1dfab466 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:53.997530 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaf82a-bf9d-4755-b0c1-680d1dfab466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:53.997805 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaf82a-bf9d-4755-b0c1-680d1dfab466 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:53.998460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaf82a-bf9d-4755-b0c1-680d1dfab466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.000410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaf82a-bf9d-4755-b0c1-680d1dfab466 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.026753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1068/2176] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:53 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:54.028401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a5f9-5b7a-4c47-bb9f-337905226ce5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.039638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960a5f9-5b7a-4c47-bb9f-337905226ce5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.045035 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9376cd-df93-4697-a5e4-02337aef812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.045666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9376cd-df93-4697-a5e4-02337aef812f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.046009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9376cd-df93-4697-a5e4-02337aef812f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.046292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9376cd-df93-4697-a5e4-02337aef812f admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.046970 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9376cd-df93-4697-a5e4-02337aef812f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.048571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9376cd-df93-4697-a5e4-02337aef812f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.059366 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1109/2177] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:54.063652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaf82a-bf9d-4755-b0c1-680d1dfab466 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.074694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaf82a-bf9d-4755-b0c1-680d1dfab466 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.080609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bc72-e655-4824-9c0c-6a7196788745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.081330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bc72-e655-4824-9c0c-6a7196788745 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.081645 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bc72-e655-4824-9c0c-6a7196788745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.081952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bc72-e655-4824-9c0c-6a7196788745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.082667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8bc72-e655-4824-9c0c-6a7196788745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.084301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8bc72-e655-4824-9c0c-6a7196788745 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.089107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9376cd-df93-4697-a5e4-02337aef812f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.090947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9b9376cd-df93-4697-a5e4-02337aef812f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.100841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1069/2178] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:54.105603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9376cd-df93-4697-a5e4-02337aef812f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.106012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bc72-e655-4824-9c0c-6a7196788745 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.111277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.112230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.112661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.113112 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] PATH_INFO: `/v3/projects/e7356ab11b4148239121cc01ee4147fc` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.115038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7356ab11b4148239121cc01ee4147fc)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.117571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bc72-e655-4824-9c0c-6a7196788745 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.124053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.125578 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734d5a-a92e-4b85-bd01-afcb3ccf5fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.126533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734d5a-a92e-4b85-bd01-afcb3ccf5fed admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.127028 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734d5a-a92e-4b85-bd01-afcb3ccf5fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.127394 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734d5a-a92e-4b85-bd01-afcb3ccf5fed admin admin] PATH_INFO: `/v3/projects/094928f378834c47b1b2c8b733de1147/users/ee6aaebac2e54c26abbd6d4b617f72a7/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.144191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0734d5a-a92e-4b85-bd01-afcb3ccf5fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=094928f378834c47b1b2c8b733de1147, user_id=ee6aaebac2e54c26abbd6d4b617f72a7, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.146956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0734d5a-a92e-4b85-bd01-afcb3ccf5fed admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.162837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1070/2179] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:54 2022] PUT /identity/v3/projects/094928f378834c47b1b2c8b733de1147/users/ee6aaebac2e54c26abbd6d4b617f72a7/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:54.173097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ee0b8-293c-4f8e-af23-718d69be3f4b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.173331 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ee0b8-293c-4f8e-af23-718d69be3f4b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.173580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ee0b8-293c-4f8e-af23-718d69be3f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.174612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7356ab11b4148239121cc01ee4147fc', 'request_id': 'req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.181160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7356ab11b4148239121cc01ee4147fc', 'request_id': 'req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.188119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7356ab11b4148239121cc01ee4147fc', 'request_id': 'req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.201627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] The token cache is being invalidate because project e7356ab11b4148239121cc01ee4147fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:54.201982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.202614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1a8af1dc-37f8-4bb2-bfdf-b4985d15a33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.202784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0c4ee0b8-293c-4f8e-af23-718d69be3f4b None None] MFA Rules not processed for user `ee6aaebac2e54c26abbd6d4b617f72a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:54.203997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0c4ee0b8-293c-4f8e-af23-718d69be3f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.204599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1110/2180] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:54 2022] DELETE /identity/v3/projects/e7356ab11b4148239121cc01ee4147fc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:54.209123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb82d-f989-4b38-acd7-cb8fb97ab97e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.209937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb82d-f989-4b38-acd7-cb8fb97ab97e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.209937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb82d-f989-4b38-acd7-cb8fb97ab97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.232900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5a3fb82d-f989-4b38-acd7-cb8fb97ab97e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:54.234141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5a3fb82d-f989-4b38-acd7-cb8fb97ab97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.272995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1071/2181] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:54.285027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ee0b8-293c-4f8e-af23-718d69be3f4b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.286788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0c4ee0b8-293c-4f8e-af23-718d69be3f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.307500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1111/2182] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:54.315602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3b1de-9c2d-4b38-8e8c-46c54768da75 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.315890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3b1de-9c2d-4b38-8e8c-46c54768da75 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.316192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3b1de-9c2d-4b38-8e8c-46c54768da75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.337233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b7f3b1de-9c2d-4b38-8e8c-46c54768da75 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:54.338460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b7f3b1de-9c2d-4b38-8e8c-46c54768da75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.346438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1112/2183] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:54.350959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3b1de-9c2d-4b38-8e8c-46c54768da75 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.359817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3b1de-9c2d-4b38-8e8c-46c54768da75 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.364387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922b06e-0516-43aa-831c-d55776751f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.364978 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922b06e-0516-43aa-831c-d55776751f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.365257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922b06e-0516-43aa-831c-d55776751f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.365528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922b06e-0516-43aa-831c-d55776751f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.365859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ee0b8-293c-4f8e-af23-718d69be3f4b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.366177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922b06e-0516-43aa-831c-d55776751f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:54.367109 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922b06e-0516-43aa-831c-d55776751f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.368703 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922b06e-0516-43aa-831c-d55776751f7a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.371936 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51dd27-9800-411b-8a96-108ffd31dea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.372552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51dd27-9800-411b-8a96-108ffd31dea9 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.372834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51dd27-9800-411b-8a96-108ffd31dea9 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.373109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51dd27-9800-411b-8a96-108ffd31dea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.380324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1113/2184] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:29:54.381202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51dd27-9800-411b-8a96-108ffd31dea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.382839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51dd27-9800-411b-8a96-108ffd31dea9 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.384472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922b06e-0516-43aa-831c-d55776751f7a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.391817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1072/2185] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:29:54.395694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922b06e-0516-43aa-831c-d55776751f7a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.400635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d47592-56f6-4577-96e9-f42c5b82decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.401246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d47592-56f6-4577-96e9-f42c5b82decd admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.401525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d47592-56f6-4577-96e9-f42c5b82decd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.401796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d47592-56f6-4577-96e9-f42c5b82decd admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.402458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d47592-56f6-4577-96e9-f42c5b82decd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.404415 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d47592-56f6-4577-96e9-f42c5b82decd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.430395 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:54.448071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1114/2186] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:54 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:54.449241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51dd27-9800-411b-8a96-108ffd31dea9 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.458332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51dd27-9800-411b-8a96-108ffd31dea9 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.462105 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:54.526072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66613f1-7a2d-4a60-ab10-060d457a608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.526841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66613f1-7a2d-4a60-ab10-060d457a608e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.527120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66613f1-7a2d-4a60-ab10-060d457a608e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.527388 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66613f1-7a2d-4a60-ab10-060d457a608e admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.528011 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66613f1-7a2d-4a60-ab10-060d457a608e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.529903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66613f1-7a2d-4a60-ab10-060d457a608e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.557765 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1073/2187] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:54 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:54.558967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d47592-56f6-4577-96e9-f42c5b82decd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.567113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d47592-56f6-4577-96e9-f42c5b82decd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.571768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e6dd3-f049-47af-a147-ac785a399adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.572380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e6dd3-f049-47af-a147-ac785a399adb admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.572664 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e6dd3-f049-47af-a147-ac785a399adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.572941 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e6dd3-f049-47af-a147-ac785a399adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.573593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e6dd3-f049-47af-a147-ac785a399adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.575211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e6dd3-f049-47af-a147-ac785a399adb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.586769 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1115/2188] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:54.589879 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66613f1-7a2d-4a60-ab10-060d457a608e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.601677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66613f1-7a2d-4a60-ab10-060d457a608e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.604464 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e6dd3-f049-47af-a147-ac785a399adb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.606646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-071e6dd3-f049-47af-a147-ac785a399adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.607755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca98d9-0e15-4ec8-aa1e-b791d31f076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.608456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca98d9-0e15-4ec8-aa1e-b791d31f076f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.608764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca98d9-0e15-4ec8-aa1e-b791d31f076f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.609071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca98d9-0e15-4ec8-aa1e-b791d31f076f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.609776 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca98d9-0e15-4ec8-aa1e-b791d31f076f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.611469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca98d9-0e15-4ec8-aa1e-b791d31f076f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.621085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e6dd3-f049-47af-a147-ac785a399adb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.623467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1074/2189] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:54.626373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.627085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.627218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca98d9-0e15-4ec8-aa1e-b791d31f076f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.627377 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.627654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] PATH_INFO: `/v3/users/ee6aaebac2e54c26abbd6d4b617f72a7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.628823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6aaebac2e54c26abbd6d4b617f72a7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.630764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.638074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca98d9-0e15-4ec8-aa1e-b791d31f076f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.643522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025d95e-a9a3-4379-bda4-2626ff040e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.644207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d95e-a9a3-4379-bda4-2626ff040e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.644772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d95e-a9a3-4379-bda4-2626ff040e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.645051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d95e-a9a3-4379-bda4-2626ff040e9f admin admin] PATH_INFO: `/v3/projects/48de9bff692b4e96a14fa5632e1a4531/users/cc85027f65e64e3f925d9b208121fdfb/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.661869 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025d95e-a9a3-4379-bda4-2626ff040e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48de9bff692b4e96a14fa5632e1a4531, user_id=cc85027f65e64e3f925d9b208121fdfb, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.665182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025d95e-a9a3-4379-bda4-2626ff040e9f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.679558 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1075/2190] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:54 2022] PUT /identity/v3/projects/48de9bff692b4e96a14fa5632e1a4531/users/cc85027f65e64e3f925d9b208121fdfb/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:54.680700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6aaebac2e54c26abbd6d4b617f72a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.691282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aca2e3-aadd-49a7-bab7-0c652a191eec None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.691570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aca2e3-aadd-49a7-bab7-0c652a191eec None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.691851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aca2e3-aadd-49a7-bab7-0c652a191eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.693336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6aaebac2e54c26abbd6d4b617f72a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.700901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6aaebac2e54c26abbd6d4b617f72a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.701578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6aaebac2e54c26abbd6d4b617f72a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.713755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c94d94-dd3b-47c4-949a-b8a033be7138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6aaebac2e54c26abbd6d4b617f72a7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:54.720232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1116/2191] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:54 2022] DELETE /identity/v3/users/ee6aaebac2e54c26abbd6d4b617f72a7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:54.721865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-77aca2e3-aadd-49a7-bab7-0c652a191eec None None] MFA Rules not processed for user `cc85027f65e64e3f925d9b208121fdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:54.723087 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-77aca2e3-aadd-49a7-bab7-0c652a191eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.724665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacb2e5-3564-40be-a5e5-d13fab062409 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.724964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacb2e5-3564-40be-a5e5-d13fab062409 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.725230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacb2e5-3564-40be-a5e5-d13fab062409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.744987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-adacb2e5-3564-40be-a5e5-d13fab062409 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:54.746232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-adacb2e5-3564-40be-a5e5-d13fab062409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.791309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1076/2192] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:54.795814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aca2e3-aadd-49a7-bab7-0c652a191eec None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.798020 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-77aca2e3-aadd-49a7-bab7-0c652a191eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.809113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1117/2193] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:54.819055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacb2e5-3564-40be-a5e5-d13fab062409 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.820569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-adacb2e5-3564-40be-a5e5-d13fab062409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:54.860513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:54.875509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aca2e3-aadd-49a7-bab7-0c652a191eec None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.881132 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395fd9d-4394-427a-99df-58b4adf7e227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.881744 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395fd9d-4394-427a-99df-58b4adf7e227 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.882025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395fd9d-4394-427a-99df-58b4adf7e227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.882340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395fd9d-4394-427a-99df-58b4adf7e227 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.882483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacb2e5-3564-40be-a5e5-d13fab062409 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.882987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395fd9d-4394-427a-99df-58b4adf7e227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.885654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395fd9d-4394-427a-99df-58b4adf7e227 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.886367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7020f5-dae0-4766-a4a2-2038faa69d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.887032 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7020f5-dae0-4766-a4a2-2038faa69d60 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.887309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7020f5-dae0-4766-a4a2-2038faa69d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.887592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7020f5-dae0-4766-a4a2-2038faa69d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.898449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7020f5-dae0-4766-a4a2-2038faa69d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.899916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7020f5-dae0-4766-a4a2-2038faa69d60 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:54.909798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1118/2194] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:29:54.913819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1077/2195] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:54 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:54.917694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7020f5-dae0-4766-a4a2-2038faa69d60 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:54.922581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:54.930060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7020f5-dae0-4766-a4a2-2038faa69d60 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:54.990733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55b767-936d-4a78-bff4-1dd00f693ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:54.991355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55b767-936d-4a78-bff4-1dd00f693ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:54.991632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55b767-936d-4a78-bff4-1dd00f693ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:54.992270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55b767-936d-4a78-bff4-1dd00f693ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:54.992953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55b767-936d-4a78-bff4-1dd00f693ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:54.994981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55b767-936d-4a78-bff4-1dd00f693ee5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.020865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1119/2196] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:54 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:55.022107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395fd9d-4394-427a-99df-58b4adf7e227 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.033382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395fd9d-4394-427a-99df-58b4adf7e227 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.038266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab2ef9-0379-445b-806c-d6a752058ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.038931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab2ef9-0379-445b-806c-d6a752058ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.039192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab2ef9-0379-445b-806c-d6a752058ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.039462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab2ef9-0379-445b-806c-d6a752058ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.040247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab2ef9-0379-445b-806c-d6a752058ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.041836 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab2ef9-0379-445b-806c-d6a752058ac9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.052157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1078/2197] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:55.063976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55b767-936d-4a78-bff4-1dd00f693ee5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.074738 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55b767-936d-4a78-bff4-1dd00f693ee5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.079883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fae15-a415-43e6-950c-6c7c3668c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.080685 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fae15-a415-43e6-950c-6c7c3668c8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.080993 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fae15-a415-43e6-950c-6c7c3668c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.081284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fae15-a415-43e6-950c-6c7c3668c8b4 admin admin] PATH_INFO: `/v3/projects/35791813e0ee45f28716109d18c0126b/users/1250f40844274ab0a39849a2fa9f9998/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.098247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fae15-a415-43e6-950c-6c7c3668c8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35791813e0ee45f28716109d18c0126b, user_id=1250f40844274ab0a39849a2fa9f9998, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.100947 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fae15-a415-43e6-950c-6c7c3668c8b4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.114468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1120/2198] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:55 2022] PUT /identity/v3/projects/35791813e0ee45f28716109d18c0126b/users/1250f40844274ab0a39849a2fa9f9998/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:55.118812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab2ef9-0379-445b-806c-d6a752058ac9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.128854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab2ef9-0379-445b-806c-d6a752058ac9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.188707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec411c-58b8-4a47-af13-47873443acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.189339 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec411c-58b8-4a47-af13-47873443acf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.189650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec411c-58b8-4a47-af13-47873443acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.189892 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec411c-58b8-4a47-af13-47873443acf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.190665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec411c-58b8-4a47-af13-47873443acf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.191547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fae15-a415-43e6-950c-6c7c3668c8b4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.192484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec411c-58b8-4a47-af13-47873443acf3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.193906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7f3fae15-a415-43e6-950c-6c7c3668c8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.203878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1079/2199] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:55.208609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec411c-58b8-4a47-af13-47873443acf3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.212486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fae15-a415-43e6-950c-6c7c3668c8b4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.219040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.219897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.220115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec411c-58b8-4a47-af13-47873443acf3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.220330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.220506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] PATH_INFO: `/v3/projects/094928f378834c47b1b2c8b733de1147` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.222045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=094928f378834c47b1b2c8b733de1147)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.224376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.225841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2136a-8ef5-43f9-960a-b3eb61cc0a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.226691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2136a-8ef5-43f9-960a-b3eb61cc0a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.227004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2136a-8ef5-43f9-960a-b3eb61cc0a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.227285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2136a-8ef5-43f9-960a-b3eb61cc0a3c admin admin] PATH_INFO: `/v3/projects/35791813e0ee45f28716109d18c0126b/users/1250f40844274ab0a39849a2fa9f9998/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.229314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2136a-8ef5-43f9-960a-b3eb61cc0a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35791813e0ee45f28716109d18c0126b, user_id=1250f40844274ab0a39849a2fa9f9998, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.232001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2136a-8ef5-43f9-960a-b3eb61cc0a3c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.244371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1080/2200] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:55 2022] PUT /identity/v3/projects/35791813e0ee45f28716109d18c0126b/users/1250f40844274ab0a39849a2fa9f9998/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:55.254634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282731c-6b19-4fc6-8a76-168ef1eb4b8b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.254974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282731c-6b19-4fc6-8a76-168ef1eb4b8b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.255334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282731c-6b19-4fc6-8a76-168ef1eb4b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.274255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094928f378834c47b1b2c8b733de1147', 'request_id': 'req-31726bb4-dcbd-476b-91ea-bc251abaed8e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.279909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094928f378834c47b1b2c8b733de1147', 'request_id': 'req-31726bb4-dcbd-476b-91ea-bc251abaed8e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.283160 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7282731c-6b19-4fc6-8a76-168ef1eb4b8b None None] MFA Rules not processed for user `1250f40844274ab0a39849a2fa9f9998`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:55.284434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7282731c-6b19-4fc6-8a76-168ef1eb4b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.286448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094928f378834c47b1b2c8b733de1147', 'request_id': 'req-31726bb4-dcbd-476b-91ea-bc251abaed8e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.299964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] The token cache is being invalidate because project 094928f378834c47b1b2c8b733de1147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:55.300291 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.300965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-31726bb4-dcbd-476b-91ea-bc251abaed8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.302465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1121/2201] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:55 2022] DELETE /identity/v3/projects/094928f378834c47b1b2c8b733de1147 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:55.307222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce370844-5699-4343-8881-4c638dc828ea None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.307531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce370844-5699-4343-8881-4c638dc828ea None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.307806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce370844-5699-4343-8881-4c638dc828ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.326834 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ce370844-5699-4343-8881-4c638dc828ea None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:55.328051 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ce370844-5699-4343-8881-4c638dc828ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.355068 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1081/2202] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:55.367265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282731c-6b19-4fc6-8a76-168ef1eb4b8b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.368649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7282731c-6b19-4fc6-8a76-168ef1eb4b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.373184 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:55.391509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1122/2203] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:55.399572 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e44a2-77f5-4d8e-9a24-8aa325c7a818 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.399864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e44a2-77f5-4d8e-9a24-8aa325c7a818 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.400141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e44a2-77f5-4d8e-9a24-8aa325c7a818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.402746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:55.421237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-864e44a2-77f5-4d8e-9a24-8aa325c7a818 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:55.422441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-864e44a2-77f5-4d8e-9a24-8aa325c7a818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.425190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282731c-6b19-4fc6-8a76-168ef1eb4b8b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.428899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdbc93-8aeb-4461-8192-fcc3bb27162a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.429547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdbc93-8aeb-4461-8192-fcc3bb27162a service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.429831 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdbc93-8aeb-4461-8192-fcc3bb27162a service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.430113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdbc93-8aeb-4461-8192-fcc3bb27162a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.430791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1123/2204] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:55.435229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e44a2-77f5-4d8e-9a24-8aa325c7a818 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.439761 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdbc93-8aeb-4461-8192-fcc3bb27162a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.441241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdbc93-8aeb-4461-8192-fcc3bb27162a service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.444689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e44a2-77f5-4d8e-9a24-8aa325c7a818 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.450081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.450681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.450825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1082/2205] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:29:55.452724 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.453006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.453670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:55.453980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.455602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.471399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1124/2206] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:29:55.472497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdbc93-8aeb-4461-8192-fcc3bb27162a service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.485031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdbc93-8aeb-4461-8192-fcc3bb27162a service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.490290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0f98d-b032-4e4e-a367-aa1b335a7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.490953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0f98d-b032-4e4e-a367-aa1b335a7adf admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.491229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0f98d-b032-4e4e-a367-aa1b335a7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.491507 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0f98d-b032-4e4e-a367-aa1b335a7adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.492540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0f98d-b032-4e4e-a367-aa1b335a7adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.494449 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0f98d-b032-4e4e-a367-aa1b335a7adf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.516779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.519043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.527801 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1083/2207] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:55 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:55.531835 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0f98d-b032-4e4e-a367-aa1b335a7adf admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.532446 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089767-d0a1-49b3-b874-685fa548f49a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.596665 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.597353 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.597651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.597815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0f98d-b032-4e4e-a367-aa1b335a7adf admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.597922 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] PATH_INFO: `/v3/users/cc85027f65e64e3f925d9b208121fdfb` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.599195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc85027f65e64e3f925d9b208121fdfb)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.601311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.603285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10139d9-2766-40f0-ba54-191b5e4c0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.603918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10139d9-2766-40f0-ba54-191b5e4c0df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.604172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10139d9-2766-40f0-ba54-191b5e4c0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.604442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10139d9-2766-40f0-ba54-191b5e4c0df8 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.605097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10139d9-2766-40f0-ba54-191b5e4c0df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.607181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10139d9-2766-40f0-ba54-191b5e4c0df8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.630666 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1084/2208] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:55 2022] POST /identity/v3/users => generated 279 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:55.634828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10139d9-2766-40f0-ba54-191b5e4c0df8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.645813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10139d9-2766-40f0-ba54-191b5e4c0df8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.650285 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc85027f65e64e3f925d9b208121fdfb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.650648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24c805-1a0a-478d-9179-40ecb29f47a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.651279 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24c805-1a0a-478d-9179-40ecb29f47a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.651557 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24c805-1a0a-478d-9179-40ecb29f47a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.651829 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24c805-1a0a-478d-9179-40ecb29f47a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.652470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24c805-1a0a-478d-9179-40ecb29f47a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.654076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24c805-1a0a-478d-9179-40ecb29f47a0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.657946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc85027f65e64e3f925d9b208121fdfb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.664484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1085/2209] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:55.665209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc85027f65e64e3f925d9b208121fdfb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.665893 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc85027f65e64e3f925d9b208121fdfb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.668390 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24c805-1a0a-478d-9179-40ecb29f47a0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.678044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24c805-1a0a-478d-9179-40ecb29f47a0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.678172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-76a4eb26-b7d2-43ba-b449-293b286f7518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc85027f65e64e3f925d9b208121fdfb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:55.682821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83e931-1f0b-4f01-9702-c91dde8e3506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.683411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e931-1f0b-4f01-9702-c91dde8e3506 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.683692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e931-1f0b-4f01-9702-c91dde8e3506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.683965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e931-1f0b-4f01-9702-c91dde8e3506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.684611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83e931-1f0b-4f01-9702-c91dde8e3506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.684764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1125/2210] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:55 2022] DELETE /identity/v3/users/cc85027f65e64e3f925d9b208121fdfb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:55.686497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83e931-1f0b-4f01-9702-c91dde8e3506 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.689094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f62d69-422c-47d1-8513-223d9ffe1cee None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.689456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f62d69-422c-47d1-8513-223d9ffe1cee None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.689731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f62d69-422c-47d1-8513-223d9ffe1cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.697873 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1086/2211] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:29:55.702024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83e931-1f0b-4f01-9702-c91dde8e3506 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.703850 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9d83e931-1f0b-4f01-9702-c91dde8e3506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.709260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-99f62d69-422c-47d1-8513-223d9ffe1cee None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:55.710424 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-99f62d69-422c-47d1-8513-223d9ffe1cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.716401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83e931-1f0b-4f01-9702-c91dde8e3506 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.755832 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:55.773338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1126/2212] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:55.781900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505a86c-65d5-4350-8207-9f3f52d197ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.782634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505a86c-65d5-4350-8207-9f3f52d197ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.782943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505a86c-65d5-4350-8207-9f3f52d197ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.783151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f62d69-422c-47d1-8513-223d9ffe1cee None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.783254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505a86c-65d5-4350-8207-9f3f52d197ec admin admin] PATH_INFO: `/v3/projects/9e2d6c9bc0974152a10afbd7f3d992eb/users/9f4efd79024a4a4380b8c75b06f0e0d2/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.784699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-99f62d69-422c-47d1-8513-223d9ffe1cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.798389 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505a86c-65d5-4350-8207-9f3f52d197ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2d6c9bc0974152a10afbd7f3d992eb, user_id=9f4efd79024a4a4380b8c75b06f0e0d2, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.801125 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505a86c-65d5-4350-8207-9f3f52d197ec admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:55.817728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1087/2213] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:55 2022] PUT /identity/v3/projects/9e2d6c9bc0974152a10afbd7f3d992eb/users/9f4efd79024a4a4380b8c75b06f0e0d2/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:55.829166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e570c-f3fb-421f-9980-4ee7dd6d1418 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.829726 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e570c-f3fb-421f-9980-4ee7dd6d1418 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.830187 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e570c-f3fb-421f-9980-4ee7dd6d1418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.839895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:55.861556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f62d69-422c-47d1-8513-223d9ffe1cee None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:55.864264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d20e570c-f3fb-421f-9980-4ee7dd6d1418 None None] MFA Rules not processed for user `9f4efd79024a4a4380b8c75b06f0e0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:55.865484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d20e570c-f3fb-421f-9980-4ee7dd6d1418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:55.915591 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cdc59-06f9-4de7-b7c1-bf4200f24a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:55.916294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cdc59-06f9-4de7-b7c1-bf4200f24a20 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:55.916574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cdc59-06f9-4de7-b7c1-bf4200f24a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:55.916848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cdc59-06f9-4de7-b7c1-bf4200f24a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:55.944772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1088/2214] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:55.948611 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e570c-f3fb-421f-9980-4ee7dd6d1418 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:55.986137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cdc59-06f9-4de7-b7c1-bf4200f24a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:55.987642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cdc59-06f9-4de7-b7c1-bf4200f24a20 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.002427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1127/2215] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:56.017234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e570c-f3fb-421f-9980-4ee7dd6d1418 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.022570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25009a-ba40-4cbc-beab-549af3b73d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.022570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25009a-ba40-4cbc-beab-549af3b73d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.023048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25009a-ba40-4cbc-beab-549af3b73d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.023215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25009a-ba40-4cbc-beab-549af3b73d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.023981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25009a-ba40-4cbc-beab-549af3b73d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.025876 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25009a-ba40-4cbc-beab-549af3b73d19 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.057376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1089/2216] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:55 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:56.058550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cdc59-06f9-4de7-b7c1-bf4200f24a20 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:56.068378 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cdc59-06f9-4de7-b7c1-bf4200f24a20 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.128057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:56.135599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921a58-8434-4765-a71f-8512fe19060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.136306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921a58-8434-4765-a71f-8512fe19060b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.136581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921a58-8434-4765-a71f-8512fe19060b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.136863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921a58-8434-4765-a71f-8512fe19060b admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.137507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab921a58-8434-4765-a71f-8512fe19060b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.139452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab921a58-8434-4765-a71f-8512fe19060b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.165094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1128/2217] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:56 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:56.166676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25009a-ba40-4cbc-beab-549af3b73d19 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:56.178355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25009a-ba40-4cbc-beab-549af3b73d19 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.183659 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0afd89-89de-4280-80c2-47abdf9655a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.184298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0afd89-89de-4280-80c2-47abdf9655a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.184570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0afd89-89de-4280-80c2-47abdf9655a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.184839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0afd89-89de-4280-80c2-47abdf9655a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.185458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0afd89-89de-4280-80c2-47abdf9655a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.187293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0afd89-89de-4280-80c2-47abdf9655a7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.197943 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1090/2218] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:56.202153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921a58-8434-4765-a71f-8512fe19060b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:56.213000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921a58-8434-4765-a71f-8512fe19060b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.218126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aec576-6dc4-47db-93b9-e465c848ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.218820 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aec576-6dc4-47db-93b9-e465c848ed69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.219094 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aec576-6dc4-47db-93b9-e465c848ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.219360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aec576-6dc4-47db-93b9-e465c848ed69 admin admin] PATH_INFO: `/v3/projects/03498c8eb5d0418d916077339c757624/users/eadd598b252a4712a9eb22e79f161e77/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.235789 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aec576-6dc4-47db-93b9-e465c848ed69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03498c8eb5d0418d916077339c757624, user_id=eadd598b252a4712a9eb22e79f161e77, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.238568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aec576-6dc4-47db-93b9-e465c848ed69 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.253979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1129/2219] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:56 2022] PUT /identity/v3/projects/03498c8eb5d0418d916077339c757624/users/eadd598b252a4712a9eb22e79f161e77/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:56.258052 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0afd89-89de-4280-80c2-47abdf9655a7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:56.269237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0afd89-89de-4280-80c2-47abdf9655a7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.331574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df820bd8-8729-4685-8783-c9ac3e0ad2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.332213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820bd8-8729-4685-8783-c9ac3e0ad2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.332491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820bd8-8729-4685-8783-c9ac3e0ad2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.332764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820bd8-8729-4685-8783-c9ac3e0ad2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.333423 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df820bd8-8729-4685-8783-c9ac3e0ad2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.335270 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df820bd8-8729-4685-8783-c9ac3e0ad2f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.345594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1091/2220] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:56.350246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aec576-6dc4-47db-93b9-e465c848ed69 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:56.361370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aec576-6dc4-47db-93b9-e465c848ed69 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.366344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9039c-49f1-4d71-9d6e-e7a1f07940cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.367573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9039c-49f1-4d71-9d6e-e7a1f07940cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.367850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9039c-49f1-4d71-9d6e-e7a1f07940cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.368145 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9039c-49f1-4d71-9d6e-e7a1f07940cf admin admin] PATH_INFO: `/v3/projects/03498c8eb5d0418d916077339c757624/users/eadd598b252a4712a9eb22e79f161e77/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.370218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9039c-49f1-4d71-9d6e-e7a1f07940cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=03498c8eb5d0418d916077339c757624, user_id=eadd598b252a4712a9eb22e79f161e77, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.372919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9039c-49f1-4d71-9d6e-e7a1f07940cf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.385065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1130/2221] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:56 2022] PUT /identity/v3/projects/03498c8eb5d0418d916077339c757624/users/eadd598b252a4712a9eb22e79f161e77/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:56.395497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c43882-6daf-4faa-a348-0b1d9ca7f387 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.395790 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c43882-6daf-4faa-a348-0b1d9ca7f387 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.396073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c43882-6daf-4faa-a348-0b1d9ca7f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.404993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:56.427469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-62c43882-6daf-4faa-a348-0b1d9ca7f387 None None] MFA Rules not processed for user `eadd598b252a4712a9eb22e79f161e77`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:56.428732 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-62c43882-6daf-4faa-a348-0b1d9ca7f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:56.500840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1092/2222] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:56.512844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9039c-49f1-4d71-9d6e-e7a1f07940cf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:56.514682 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1df9039c-49f1-4d71-9d6e-e7a1f07940cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:56.577698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9039c-49f1-4d71-9d6e-e7a1f07940cf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.581656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b93dc8-f67e-412e-9d5e-f295d33157aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.582303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b93dc8-f67e-412e-9d5e-f295d33157aa service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.582582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b93dc8-f67e-412e-9d5e-f295d33157aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.582895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b93dc8-f67e-412e-9d5e-f295d33157aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.593195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b93dc8-f67e-412e-9d5e-f295d33157aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.593848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c43882-6daf-4faa-a348-0b1d9ca7f387 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:56.594915 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b93dc8-f67e-412e-9d5e-f295d33157aa service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.596465 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-62c43882-6daf-4faa-a348-0b1d9ca7f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:56.618557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1131/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:56.684826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c43882-6daf-4faa-a348-0b1d9ca7f387 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.689590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.690303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.690423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b93dc8-f67e-412e-9d5e-f295d33157aa service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:56.690597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.690890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] PATH_INFO: `/v3/projects/48de9bff692b4e96a14fa5632e1a4531` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.692175 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48de9bff692b4e96a14fa5632e1a4531)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.694070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.699289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b93dc8-f67e-412e-9d5e-f295d33157aa service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.703066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb56f9-c02c-489a-9cd3-f65c947086df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.703716 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb56f9-c02c-489a-9cd3-f65c947086df service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.703996 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb56f9-c02c-489a-9cd3-f65c947086df service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.704263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb56f9-c02c-489a-9cd3-f65c947086df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.743139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48de9bff692b4e96a14fa5632e1a4531', 'request_id': 'req-e2a8f6a5-a632-452d-8755-86987f29cd09'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.751662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48de9bff692b4e96a14fa5632e1a4531', 'request_id': 'req-e2a8f6a5-a632-452d-8755-86987f29cd09'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.757987 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48de9bff692b4e96a14fa5632e1a4531', 'request_id': 'req-e2a8f6a5-a632-452d-8755-86987f29cd09'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.761932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb56f9-c02c-489a-9cd3-f65c947086df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.763394 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb56f9-c02c-489a-9cd3-f65c947086df service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.769588 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] The token cache is being invalidate because project 48de9bff692b4e96a14fa5632e1a4531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:56.769878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.770531 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.772074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1093/2224] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:56 2022] DELETE /identity/v3/projects/48de9bff692b4e96a14fa5632e1a4531 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:56.772412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1132/2225] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:29:56.776029 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:56.777320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:56.801649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:56.850566 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f6a5-a632-452d-8755-86987f29cd09 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:56.856703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:56.857346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:56.857626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:56.858453 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] PATH_INFO: `/v3/users/1250f40844274ab0a39849a2fa9f9998` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:56.859659 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1250f40844274ab0a39849a2fa9f9998)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:56.862185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:56.920106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1250f40844274ab0a39849a2fa9f9998'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.930044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1250f40844274ab0a39849a2fa9f9998'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.940427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1250f40844274ab0a39849a2fa9f9998'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.948546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1250f40844274ab0a39849a2fa9f9998'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.949159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f4b8554e-f908-4a78-939a-ab9ad27d7949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1250f40844274ab0a39849a2fa9f9998'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:56.955598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1094/2226] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:29:56 2022] DELETE /identity/v3/users/1250f40844274ab0a39849a2fa9f9998 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:57.242125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb56f9-c02c-489a-9cd3-f65c947086df service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:57.254027 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb56f9-c02c-489a-9cd3-f65c947086df service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:57.301793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:57.313569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:57.314211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.314495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.314796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] PATH_INFO: `/v3/projects/35791813e0ee45f28716109d18c0126b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.315988 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35791813e0ee45f28716109d18c0126b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:57.317906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:57.364451 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35791813e0ee45f28716109d18c0126b', 'request_id': 'req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:57.370519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35791813e0ee45f28716109d18c0126b', 'request_id': 'req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:57.376758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35791813e0ee45f28716109d18c0126b', 'request_id': 'req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:57.390824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] The token cache is being invalidate because project 35791813e0ee45f28716109d18c0126b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:57.391114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:57.391757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eba9e013-ae77-4c49-a1f7-4e3c215ddcb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:57.393327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1133/2227] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:29:57 2022] DELETE /identity/v3/projects/35791813e0ee45f28716109d18c0126b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:57.398290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685cb09-cd6e-47b8-9f02-82cac4e0cfa5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.398577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685cb09-cd6e-47b8-9f02-82cac4e0cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.398889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685cb09-cd6e-47b8-9f02-82cac4e0cfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.419191 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c685cb09-cd6e-47b8-9f02-82cac4e0cfa5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:57.420384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c685cb09-cd6e-47b8-9f02-82cac4e0cfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:57.484676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1095/2228] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:57.493132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e85fa-1428-4fbe-b37e-16139d0fd3a5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.493412 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e85fa-1428-4fbe-b37e-16139d0fd3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.493707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e85fa-1428-4fbe-b37e-16139d0fd3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.514604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-832e85fa-1428-4fbe-b37e-16139d0fd3a5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:57.515869 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-832e85fa-1428-4fbe-b37e-16139d0fd3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:57.524875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1134/2229] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:57.529293 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685cb09-cd6e-47b8-9f02-82cac4e0cfa5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:57.539549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685cb09-cd6e-47b8-9f02-82cac4e0cfa5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:57.545199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d27f0e-f64f-4775-ba3b-b04ddadc91af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:57.545807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d27f0e-f64f-4775-ba3b-b04ddadc91af admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.546083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d27f0e-f64f-4775-ba3b-b04ddadc91af admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.546352 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d27f0e-f64f-4775-ba3b-b04ddadc91af admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.547067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d27f0e-f64f-4775-ba3b-b04ddadc91af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:57.547371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d27f0e-f64f-4775-ba3b-b04ddadc91af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:57.548991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d27f0e-f64f-4775-ba3b-b04ddadc91af admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:57.561528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1096/2230] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:29:57.566104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e85fa-1428-4fbe-b37e-16139d0fd3a5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:57.575765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e85fa-1428-4fbe-b37e-16139d0fd3a5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:57.581623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600abd91-2a48-4b9b-baa3-98fbede7de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:57.582229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600abd91-2a48-4b9b-baa3-98fbede7de8c admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.582531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600abd91-2a48-4b9b-baa3-98fbede7de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.582831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600abd91-2a48-4b9b-baa3-98fbede7de8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.583462 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600abd91-2a48-4b9b-baa3-98fbede7de8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:57.585372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600abd91-2a48-4b9b-baa3-98fbede7de8c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:57.615880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1135/2231] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:57 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:57.620604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d27f0e-f64f-4775-ba3b-b04ddadc91af admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:57.631019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d27f0e-f64f-4775-ba3b-b04ddadc91af admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:57.655672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:57.690177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5dc8-beb7-4dd7-afab-a64061857424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:57.690794 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5dc8-beb7-4dd7-afab-a64061857424 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.691112 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5dc8-beb7-4dd7-afab-a64061857424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.691358 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5dc8-beb7-4dd7-afab-a64061857424 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.691983 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5dc8-beb7-4dd7-afab-a64061857424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:57.693910 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5dc8-beb7-4dd7-afab-a64061857424 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:57.717330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1097/2232] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:57 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:57.721562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600abd91-2a48-4b9b-baa3-98fbede7de8c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:57.731763 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600abd91-2a48-4b9b-baa3-98fbede7de8c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:57.736924 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bf07e-0051-4568-aa29-2c234b1d7f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:57.737656 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bf07e-0051-4568-aa29-2c234b1d7f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.737932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bf07e-0051-4568-aa29-2c234b1d7f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.738233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bf07e-0051-4568-aa29-2c234b1d7f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.738943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0bf07e-0051-4568-aa29-2c234b1d7f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:57.740562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0bf07e-0051-4568-aa29-2c234b1d7f29 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:57.751637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1136/2233] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:57.755668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5dc8-beb7-4dd7-afab-a64061857424 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:57.766040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5dc8-beb7-4dd7-afab-a64061857424 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:57.771009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a745c7e-88f0-4bb5-a86d-747b25dd3dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:57.771580 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745c7e-88f0-4bb5-a86d-747b25dd3dff admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.771863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745c7e-88f0-4bb5-a86d-747b25dd3dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.772170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745c7e-88f0-4bb5-a86d-747b25dd3dff admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.772840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a745c7e-88f0-4bb5-a86d-747b25dd3dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:57.774434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a745c7e-88f0-4bb5-a86d-747b25dd3dff admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:57.785276 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1098/2234] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:57.789419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bf07e-0051-4568-aa29-2c234b1d7f29 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:57.801297 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bf07e-0051-4568-aa29-2c234b1d7f29 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:57.806539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2440a-2f39-45b5-99ad-a6d2678a4d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:57.807282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2440a-2f39-45b5-99ad-a6d2678a4d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.807586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2440a-2f39-45b5-99ad-a6d2678a4d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.807862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2440a-2f39-45b5-99ad-a6d2678a4d02 admin admin] PATH_INFO: `/v3/projects/68e4f70c98a648e4b317c97c0dff36dc/users/fb18b336751748898b7dbb4d5b301d97/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.822927 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2440a-2f39-45b5-99ad-a6d2678a4d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e4f70c98a648e4b317c97c0dff36dc, user_id=fb18b336751748898b7dbb4d5b301d97, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:57.825488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2440a-2f39-45b5-99ad-a6d2678a4d02 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:57.840379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1137/2235] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:57 2022] PUT /identity/v3/projects/68e4f70c98a648e4b317c97c0dff36dc/users/fb18b336751748898b7dbb4d5b301d97/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:57.909604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf3af5-6e2e-4125-9e4f-38883060a1e9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:57.910226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf3af5-6e2e-4125-9e4f-38883060a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:57.910226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf3af5-6e2e-4125-9e4f-38883060a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:57.940263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0eaf3af5-6e2e-4125-9e4f-38883060a1e9 None None] MFA Rules not processed for user `fb18b336751748898b7dbb4d5b301d97`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:57.941471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0eaf3af5-6e2e-4125-9e4f-38883060a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:58.009242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1099/2236] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:58.013877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2440a-2f39-45b5-99ad-a6d2678a4d02 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.081091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2440a-2f39-45b5-99ad-a6d2678a4d02 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.085886 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e752dd-ade5-4c87-8f83-d7b479b6e463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.086538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e752dd-ade5-4c87-8f83-d7b479b6e463 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.086816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e752dd-ade5-4c87-8f83-d7b479b6e463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.087223 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e752dd-ade5-4c87-8f83-d7b479b6e463 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.087867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e752dd-ade5-4c87-8f83-d7b479b6e463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.089762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e752dd-ade5-4c87-8f83-d7b479b6e463 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.119170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1138/2237] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:58 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:58.123220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf3af5-6e2e-4125-9e4f-38883060a1e9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.134672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf3af5-6e2e-4125-9e4f-38883060a1e9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.195660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1f6ea-435a-4041-ab8a-797e269861ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.196306 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1f6ea-435a-4041-ab8a-797e269861ee admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.196586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1f6ea-435a-4041-ab8a-797e269861ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.196858 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1f6ea-435a-4041-ab8a-797e269861ee admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.197495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1f6ea-435a-4041-ab8a-797e269861ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.199443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1f6ea-435a-4041-ab8a-797e269861ee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.226489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1100/2238] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:58 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:58.228100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e752dd-ade5-4c87-8f83-d7b479b6e463 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.233568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:58.241510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e752dd-ade5-4c87-8f83-d7b479b6e463 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.249263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49236bc-0675-4f59-a053-08e3cc545096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.249893 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49236bc-0675-4f59-a053-08e3cc545096 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.250153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49236bc-0675-4f59-a053-08e3cc545096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.250425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49236bc-0675-4f59-a053-08e3cc545096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.251131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49236bc-0675-4f59-a053-08e3cc545096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.252833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49236bc-0675-4f59-a053-08e3cc545096 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.264123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1139/2239] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:29:58.268396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1f6ea-435a-4041-ab8a-797e269861ee admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.278551 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1f6ea-435a-4041-ab8a-797e269861ee admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.283336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3b9c1-2d91-4c9b-a077-d78dd84c5682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.284213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3b9c1-2d91-4c9b-a077-d78dd84c5682 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.284341 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3b9c1-2d91-4c9b-a077-d78dd84c5682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.284612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3b9c1-2d91-4c9b-a077-d78dd84c5682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.285251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3b9c1-2d91-4c9b-a077-d78dd84c5682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.286900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3b9c1-2d91-4c9b-a077-d78dd84c5682 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.300525 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1101/2240] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:58.301749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49236bc-0675-4f59-a053-08e3cc545096 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.311933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49236bc-0675-4f59-a053-08e3cc545096 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.317204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e2527-3812-4d17-8798-f6c74a5719eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.317887 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2527-3812-4d17-8798-f6c74a5719eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.318170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2527-3812-4d17-8798-f6c74a5719eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.318449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e2527-3812-4d17-8798-f6c74a5719eb admin admin] PATH_INFO: `/v3/projects/ba3d6feb312c49798b51e63745178f74/users/23b1aeab448540df85e4476c87b82848/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.334259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e2527-3812-4d17-8798-f6c74a5719eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3d6feb312c49798b51e63745178f74, user_id=23b1aeab448540df85e4476c87b82848, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.336914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e2527-3812-4d17-8798-f6c74a5719eb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.351349 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1140/2241] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:58 2022] PUT /identity/v3/projects/ba3d6feb312c49798b51e63745178f74/users/23b1aeab448540df85e4476c87b82848/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:58.361809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3c67-d72f-4c5a-b34d-3e5c29621272 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.362192 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3c67-d72f-4c5a-b34d-3e5c29621272 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.362472 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3c67-d72f-4c5a-b34d-3e5c29621272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.388899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:58.391945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-651c3c67-d72f-4c5a-b34d-3e5c29621272 None None] MFA Rules not processed for user `23b1aeab448540df85e4476c87b82848`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:58.393781 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-651c3c67-d72f-4c5a-b34d-3e5c29621272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:58.460528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1102/2242] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:58.465246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e2527-3812-4d17-8798-f6c74a5719eb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.528103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e2527-3812-4d17-8798-f6c74a5719eb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.533047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dd2ea-ee66-4383-9a93-4a17f76a49eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.533655 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd2ea-ee66-4383-9a93-4a17f76a49eb admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.533930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd2ea-ee66-4383-9a93-4a17f76a49eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.534223 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd2ea-ee66-4383-9a93-4a17f76a49eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.534908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dd2ea-ee66-4383-9a93-4a17f76a49eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.536786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dd2ea-ee66-4383-9a93-4a17f76a49eb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.564671 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1141/2243] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:29:58 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:58.569042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c3c67-d72f-4c5a-b34d-3e5c29621272 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.580870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c3c67-d72f-4c5a-b34d-3e5c29621272 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.637512 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc44072-7014-41e3-86cf-4874211b4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.638048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44072-7014-41e3-86cf-4874211b4b5a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.638328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44072-7014-41e3-86cf-4874211b4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.638598 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44072-7014-41e3-86cf-4874211b4b5a admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.639259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc44072-7014-41e3-86cf-4874211b4b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.641207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc44072-7014-41e3-86cf-4874211b4b5a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.663240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1103/2244] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:29:58 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:58.667467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dd2ea-ee66-4383-9a93-4a17f76a49eb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.678289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dd2ea-ee66-4383-9a93-4a17f76a49eb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.684284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f892-02e4-4327-8cfd-0a5f357f5f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.684931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f892-02e4-4327-8cfd-0a5f357f5f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.685208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f892-02e4-4327-8cfd-0a5f357f5f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.685481 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f892-02e4-4327-8cfd-0a5f357f5f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.686130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f892-02e4-4327-8cfd-0a5f357f5f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.687804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f892-02e4-4327-8cfd-0a5f357f5f47 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.698751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1142/2245] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:29:58.702918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc44072-7014-41e3-86cf-4874211b4b5a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.712992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc44072-7014-41e3-86cf-4874211b4b5a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.718045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d548de6-7e6d-4807-96b7-bca022f5aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.718693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d548de6-7e6d-4807-96b7-bca022f5aacc admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.718998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d548de6-7e6d-4807-96b7-bca022f5aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.719272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d548de6-7e6d-4807-96b7-bca022f5aacc admin admin] PATH_INFO: `/v3/projects/0a316d3bdfc042298ae3a48720cd4535/users/7a70882934744db7b2c18792dc31b4c9/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.733967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d548de6-7e6d-4807-96b7-bca022f5aacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a316d3bdfc042298ae3a48720cd4535, user_id=7a70882934744db7b2c18792dc31b4c9, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.736650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d548de6-7e6d-4807-96b7-bca022f5aacc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.754955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1104/2246] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:58 2022] PUT /identity/v3/projects/0a316d3bdfc042298ae3a48720cd4535/users/7a70882934744db7b2c18792dc31b4c9/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:58.759540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f892-02e4-4327-8cfd-0a5f357f5f47 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.774214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f892-02e4-4327-8cfd-0a5f357f5f47 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.835197 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5adeae-45af-472b-8ce5-da4c8bccf306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.835817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5adeae-45af-472b-8ce5-da4c8bccf306 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.836092 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5adeae-45af-472b-8ce5-da4c8bccf306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.836373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5adeae-45af-472b-8ce5-da4c8bccf306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.837016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5adeae-45af-472b-8ce5-da4c8bccf306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.838691 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5adeae-45af-472b-8ce5-da4c8bccf306 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.851960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1143/2247] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:58.854309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d548de6-7e6d-4807-96b7-bca022f5aacc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:58.865298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d548de6-7e6d-4807-96b7-bca022f5aacc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:58.871136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102a063-8b6a-481c-88e3-cbb8af832299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:58.871797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a063-8b6a-481c-88e3-cbb8af832299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.872078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a063-8b6a-481c-88e3-cbb8af832299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.872349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a063-8b6a-481c-88e3-cbb8af832299 admin admin] PATH_INFO: `/v3/projects/0a316d3bdfc042298ae3a48720cd4535/users/7a70882934744db7b2c18792dc31b4c9/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.874407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102a063-8b6a-481c-88e3-cbb8af832299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a316d3bdfc042298ae3a48720cd4535, user_id=7a70882934744db7b2c18792dc31b4c9, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:58.877085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102a063-8b6a-481c-88e3-cbb8af832299 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:58.888380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1105/2248] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:29:58 2022] PUT /identity/v3/projects/0a316d3bdfc042298ae3a48720cd4535/users/7a70882934744db7b2c18792dc31b4c9/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:58.898641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668567-2fe7-40b6-8a05-1e281350c9df None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:58.898959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668567-2fe7-40b6-8a05-1e281350c9df None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:58.899235 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668567-2fe7-40b6-8a05-1e281350c9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:58.931494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-86668567-2fe7-40b6-8a05-1e281350c9df None None] MFA Rules not processed for user `7a70882934744db7b2c18792dc31b4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:58.932752 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-86668567-2fe7-40b6-8a05-1e281350c9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:58.960139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:59.006393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1144/2249] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:59.017508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102a063-8b6a-481c-88e3-cbb8af832299 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:59.019626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a102a063-8b6a-481c-88e3-cbb8af832299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:59.081854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102a063-8b6a-481c-88e3-cbb8af832299 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:59.085989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244c411-395f-4b7d-8178-e2aabc2b7769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:59.086593 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244c411-395f-4b7d-8178-e2aabc2b7769 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:59.086945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244c411-395f-4b7d-8178-e2aabc2b7769 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:59.087261 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244c411-395f-4b7d-8178-e2aabc2b7769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:59.096756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244c411-395f-4b7d-8178-e2aabc2b7769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:59.098187 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244c411-395f-4b7d-8178-e2aabc2b7769 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:59.102007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:59.108390 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1106/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:59.675079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86668567-2fe7-40b6-8a05-1e281350c9df None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:59.685179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86668567-2fe7-40b6-8a05-1e281350c9df None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:59.689029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c27e-81fa-458b-880e-8178a472cd24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:59.689634 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c27e-81fa-458b-880e-8178a472cd24 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:59.689911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c27e-81fa-458b-880e-8178a472cd24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:59.690219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c27e-81fa-458b-880e-8178a472cd24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:59.747861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69c27e-81fa-458b-880e-8178a472cd24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:59.749284 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69c27e-81fa-458b-880e-8178a472cd24 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:59.758455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1145/2251] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:29:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:04.026069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244c411-395f-4b7d-8178-e2aabc2b7769 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:04.027541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4244c411-395f-4b7d-8178-e2aabc2b7769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:04.041871 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244c411-395f-4b7d-8178-e2aabc2b7769 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:04.047877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9261be-adb2-4509-becb-0bbc526b34e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:04.048821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9261be-adb2-4509-becb-0bbc526b34e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:04.049172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9261be-adb2-4509-becb-0bbc526b34e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:04.049467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9261be-adb2-4509-becb-0bbc526b34e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:04.113468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9261be-adb2-4509-becb-0bbc526b34e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:04.114952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9261be-adb2-4509-becb-0bbc526b34e8 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:04.124338 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1107/2252] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:06.426269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c27e-81fa-458b-880e-8178a472cd24 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:06.504155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c27e-81fa-458b-880e-8178a472cd24 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:06.508935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:06.509577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:06.509842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:06.510126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] PATH_INFO: `/v3/users/fb18b336751748898b7dbb4d5b301d97` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:06.511302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb18b336751748898b7dbb4d5b301d97)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:06.513387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:06.573036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb18b336751748898b7dbb4d5b301d97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:06.585185 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb18b336751748898b7dbb4d5b301d97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:06.594840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb18b336751748898b7dbb4d5b301d97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:06.595563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb18b336751748898b7dbb4d5b301d97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:06.598555 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:06.611963 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb18b336751748898b7dbb4d5b301d97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:06.620084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1146/2253] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:06 2022] DELETE /identity/v3/users/fb18b336751748898b7dbb4d5b301d97 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:06.625083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdf2ec-9ea1-4472-970b-9b37c1f2428a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:06.625957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdf2ec-9ea1-4472-970b-9b37c1f2428a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:06.626296 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdf2ec-9ea1-4472-970b-9b37c1f2428a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:06.648016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b8fdf2ec-9ea1-4472-970b-9b37c1f2428a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:06.649492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b8fdf2ec-9ea1-4472-970b-9b37c1f2428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:06.759369 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1108/2254] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:06.780903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:06.782459 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:06.853409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c15cf-545c-47b0-892b-c588dde5ff29 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:06.857058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89704a99-f410-4b90-84dd-1ecb0c5b9f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:06.857681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89704a99-f410-4b90-84dd-1ecb0c5b9f0a service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:06.857954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89704a99-f410-4b90-84dd-1ecb0c5b9f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:06.858223 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89704a99-f410-4b90-84dd-1ecb0c5b9f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:06.868688 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89704a99-f410-4b90-84dd-1ecb0c5b9f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:06.870065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89704a99-f410-4b90-84dd-1ecb0c5b9f0a service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:06.880034 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1147/2255] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:07.448380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdf2ec-9ea1-4472-970b-9b37c1f2428a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:07.450055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b8fdf2ec-9ea1-4472-970b-9b37c1f2428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:07.484230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdf2ec-9ea1-4472-970b-9b37c1f2428a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:07.493516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:07.494394 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:07.496300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:07.496684 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] PATH_INFO: `/v3/projects/68e4f70c98a648e4b317c97c0dff36dc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:07.498228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e4f70c98a648e4b317c97c0dff36dc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:07.500471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:07.556048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e4f70c98a648e4b317c97c0dff36dc', 'request_id': 'req-859416a2-217e-48e7-88f7-0c4b7fdca8ea'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.566018 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e4f70c98a648e4b317c97c0dff36dc', 'request_id': 'req-859416a2-217e-48e7-88f7-0c4b7fdca8ea'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.573409 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e4f70c98a648e4b317c97c0dff36dc', 'request_id': 'req-859416a2-217e-48e7-88f7-0c4b7fdca8ea'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.586211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] The token cache is being invalidate because project 68e4f70c98a648e4b317c97c0dff36dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:07.586647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.587616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.589478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1109/2256] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:07 2022] DELETE /identity/v3/projects/68e4f70c98a648e4b317c97c0dff36dc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:07.594131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89704a99-f410-4b90-84dd-1ecb0c5b9f0a service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:07.606224 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89704a99-f410-4b90-84dd-1ecb0c5b9f0a service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:07.671198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:07.671845 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:07.672125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:07.672401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] PATH_INFO: `/v3/users/23b1aeab448540df85e4476c87b82848` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:07.673566 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b1aeab448540df85e4476c87b82848)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:07.675810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:07.733957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b1aeab448540df85e4476c87b82848'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.744563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b1aeab448540df85e4476c87b82848'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.754320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b1aeab448540df85e4476c87b82848'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.755346 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b1aeab448540df85e4476c87b82848'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.770126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b1aeab448540df85e4476c87b82848'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:07.777784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1148/2257] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:07 2022] DELETE /identity/v3/users/23b1aeab448540df85e4476c87b82848 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:08.082115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:08.083828 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:08.103518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859416a2-217e-48e7-88f7-0c4b7fdca8ea admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:08.120895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:08.165638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:08.166292 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:08.166624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:08.166883 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] PATH_INFO: `/v3/projects/ba3d6feb312c49798b51e63745178f74` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:08.168057 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3d6feb312c49798b51e63745178f74)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:08.170109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:08.228575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3d6feb312c49798b51e63745178f74', 'request_id': 'req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.237275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3d6feb312c49798b51e63745178f74', 'request_id': 'req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.243620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3d6feb312c49798b51e63745178f74', 'request_id': 'req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.255865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] The token cache is being invalidate because project ba3d6feb312c49798b51e63745178f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:08.256183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.256823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.258303 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1110/2258] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:08 2022] DELETE /identity/v3/projects/ba3d6feb312c49798b51e63745178f74 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:08.262469 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:08.264008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:08.272099 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:08.277571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c9244-28e9-4f7f-bf62-880b8503abac admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:08.338594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:08.339384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:08.339690 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:08.340014 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] PATH_INFO: `/v3/users/7a70882934744db7b2c18792dc31b4c9` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:08.341255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a70882934744db7b2c18792dc31b4c9)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:08.343328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:08.402000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a70882934744db7b2c18792dc31b4c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.411592 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a70882934744db7b2c18792dc31b4c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.419151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a70882934744db7b2c18792dc31b4c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.419819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a70882934744db7b2c18792dc31b4c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.432141 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-82f6003c-807b-4d69-a526-70dbd1447c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a70882934744db7b2c18792dc31b4c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.438439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1149/2259] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:08 2022] DELETE /identity/v3/users/7a70882934744db7b2c18792dc31b4c9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:08.713041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:08.714691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:08.731518 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5e11-f6a3-4d54-bd74-8e60503fdb07 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:08.793234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:08.793877 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:08.794154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:08.794419 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] PATH_INFO: `/v3/projects/0a316d3bdfc042298ae3a48720cd4535` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:08.795689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a316d3bdfc042298ae3a48720cd4535)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:08.797604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:08.855450 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a316d3bdfc042298ae3a48720cd4535', 'request_id': 'req-69bcf46c-00b3-42f4-9071-d4131f0c54c5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.859334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:08.868713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a316d3bdfc042298ae3a48720cd4535', 'request_id': 'req-69bcf46c-00b3-42f4-9071-d4131f0c54c5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.875267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a316d3bdfc042298ae3a48720cd4535', 'request_id': 'req-69bcf46c-00b3-42f4-9071-d4131f0c54c5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.886362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] The token cache is being invalidate because project 0a316d3bdfc042298ae3a48720cd4535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:08.886649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.887464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-69bcf46c-00b3-42f4-9071-d4131f0c54c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:08.889099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1111/2260] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:08 2022] DELETE /identity/v3/projects/0a316d3bdfc042298ae3a48720cd4535 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:08.895324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89bccf-3978-447d-916f-a92955d2fde9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:08.895838 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89bccf-3978-447d-916f-a92955d2fde9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:08.895935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89bccf-3978-447d-916f-a92955d2fde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:08.916735 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2e89bccf-3978-447d-916f-a92955d2fde9 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:08.917936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2e89bccf-3978-447d-916f-a92955d2fde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:08.981115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1150/2261] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:08.990115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b14555-c8a7-4d53-8978-c479e77c47f2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:08.990500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b14555-c8a7-4d53-8978-c479e77c47f2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:08.990986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b14555-c8a7-4d53-8978-c479e77c47f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.013244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f0b14555-c8a7-4d53-8978-c479e77c47f2 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:09.014470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f0b14555-c8a7-4d53-8978-c479e77c47f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:09.026813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1112/2262] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:09.028416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89bccf-3978-447d-916f-a92955d2fde9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.038618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89bccf-3978-447d-916f-a92955d2fde9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.044093 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb76246-2224-44fa-ae9e-2b682a736773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.044705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb76246-2224-44fa-ae9e-2b682a736773 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.044980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb76246-2224-44fa-ae9e-2b682a736773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.045246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb76246-2224-44fa-ae9e-2b682a736773 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.045897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb76246-2224-44fa-ae9e-2b682a736773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:30:09.046195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb76246-2224-44fa-ae9e-2b682a736773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.047800 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb76246-2224-44fa-ae9e-2b682a736773 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.060542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1151/2263] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:30:09.065016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b14555-c8a7-4d53-8978-c479e77c47f2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.074678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b14555-c8a7-4d53-8978-c479e77c47f2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.079821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279989d5-827c-432f-9c1f-15870d88fd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.080610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279989d5-827c-432f-9c1f-15870d88fd44 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.080954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279989d5-827c-432f-9c1f-15870d88fd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.081295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279989d5-827c-432f-9c1f-15870d88fd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.082019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279989d5-827c-432f-9c1f-15870d88fd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.084103 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279989d5-827c-432f-9c1f-15870d88fd44 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.118830 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1113/2264] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:09 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:30:09.119948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb76246-2224-44fa-ae9e-2b682a736773 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.130165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb76246-2224-44fa-ae9e-2b682a736773 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.134946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:09.190610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef645c0-ec08-408e-a40e-133ee36507a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.191315 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef645c0-ec08-408e-a40e-133ee36507a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.191596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef645c0-ec08-408e-a40e-133ee36507a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.191873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef645c0-ec08-408e-a40e-133ee36507a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.192519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef645c0-ec08-408e-a40e-133ee36507a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.194446 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef645c0-ec08-408e-a40e-133ee36507a4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.216493 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1152/2265] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:09 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:09.221048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279989d5-827c-432f-9c1f-15870d88fd44 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.232399 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279989d5-827c-432f-9c1f-15870d88fd44 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.237817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f618-0777-4610-83b9-53e08086bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.238427 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f618-0777-4610-83b9-53e08086bc6a admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.238839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f618-0777-4610-83b9-53e08086bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.239040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f618-0777-4610-83b9-53e08086bc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.239691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841f618-0777-4610-83b9-53e08086bc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.242893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841f618-0777-4610-83b9-53e08086bc6a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.252526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1114/2266] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:09.257201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef645c0-ec08-408e-a40e-133ee36507a4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.270405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef645c0-ec08-408e-a40e-133ee36507a4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.275465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fd16a-8433-44a1-ad2d-cfb13c15da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.276091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fd16a-8433-44a1-ad2d-cfb13c15da1e admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.276370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fd16a-8433-44a1-ad2d-cfb13c15da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.276642 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fd16a-8433-44a1-ad2d-cfb13c15da1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.277296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fd16a-8433-44a1-ad2d-cfb13c15da1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.278958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fd16a-8433-44a1-ad2d-cfb13c15da1e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.289762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1153/2267] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:09.294107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f618-0777-4610-83b9-53e08086bc6a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.304051 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f618-0777-4610-83b9-53e08086bc6a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.308867 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17ed45-9805-4d4e-8186-037ad0ac44ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.309517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17ed45-9805-4d4e-8186-037ad0ac44ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.309792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17ed45-9805-4d4e-8186-037ad0ac44ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.310062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17ed45-9805-4d4e-8186-037ad0ac44ef admin admin] PATH_INFO: `/v3/projects/0a78e2d274af4dc9b32cf4b34cd1705e/users/1abf455bd70e485dbac34fe04bad7a97/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.325575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17ed45-9805-4d4e-8186-037ad0ac44ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78e2d274af4dc9b32cf4b34cd1705e, user_id=1abf455bd70e485dbac34fe04bad7a97, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.328241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17ed45-9805-4d4e-8186-037ad0ac44ef admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.342665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1115/2268] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:09 2022] PUT /identity/v3/projects/0a78e2d274af4dc9b32cf4b34cd1705e/users/1abf455bd70e485dbac34fe04bad7a97/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:09.354120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773f640-594f-4515-a8d2-a29561bba2f5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.354406 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773f640-594f-4515-a8d2-a29561bba2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.354676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773f640-594f-4515-a8d2-a29561bba2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.384241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4773f640-594f-4515-a8d2-a29561bba2f5 None None] MFA Rules not processed for user `1abf455bd70e485dbac34fe04bad7a97`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:09.385469 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4773f640-594f-4515-a8d2-a29561bba2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:09.454537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1154/2269] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:09.459242 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17ed45-9805-4d4e-8186-037ad0ac44ef admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.524672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17ed45-9805-4d4e-8186-037ad0ac44ef admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.530069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e71a-8098-4e00-bee6-513996defa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.530682 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e71a-8098-4e00-bee6-513996defa60 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.530995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e71a-8098-4e00-bee6-513996defa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.531269 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e71a-8098-4e00-bee6-513996defa60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.531901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47e71a-8098-4e00-bee6-513996defa60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.533812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47e71a-8098-4e00-bee6-513996defa60 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.565636 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1116/2270] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:09 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:09.567059 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773f640-594f-4515-a8d2-a29561bba2f5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.577855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773f640-594f-4515-a8d2-a29561bba2f5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.648057 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c3778-6a8e-49c8-911e-afbdaecf9174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.648846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c3778-6a8e-49c8-911e-afbdaecf9174 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.649220 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c3778-6a8e-49c8-911e-afbdaecf9174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.649595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c3778-6a8e-49c8-911e-afbdaecf9174 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.650445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c3778-6a8e-49c8-911e-afbdaecf9174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.652727 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c3778-6a8e-49c8-911e-afbdaecf9174 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.674742 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1155/2271] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:09 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:30:09.678996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e71a-8098-4e00-bee6-513996defa60 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.689688 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e71a-8098-4e00-bee6-513996defa60 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.696061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3bb1d-7e19-42e3-92d4-76dfa81d32cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.696683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3bb1d-7e19-42e3-92d4-76dfa81d32cb admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.696959 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3bb1d-7e19-42e3-92d4-76dfa81d32cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.697220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3bb1d-7e19-42e3-92d4-76dfa81d32cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.698031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3bb1d-7e19-42e3-92d4-76dfa81d32cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.699673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3bb1d-7e19-42e3-92d4-76dfa81d32cb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.711376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1117/2272] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:09.715386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c3778-6a8e-49c8-911e-afbdaecf9174 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.725372 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c3778-6a8e-49c8-911e-afbdaecf9174 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.729890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcfbcf-8836-429f-b9bd-180e85561f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.730534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcfbcf-8836-429f-b9bd-180e85561f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.730843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcfbcf-8836-429f-b9bd-180e85561f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.731123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcfbcf-8836-429f-b9bd-180e85561f13 admin admin] PATH_INFO: `/v3/projects/9e96b11bda1844708b0809f3f8f54904/users/8bc7007e720b41a69867fedd767ea871/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.733308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:09.748885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcfbcf-8836-429f-b9bd-180e85561f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e96b11bda1844708b0809f3f8f54904, user_id=8bc7007e720b41a69867fedd767ea871, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.751568 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcfbcf-8836-429f-b9bd-180e85561f13 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.765630 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1156/2273] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:09 2022] PUT /identity/v3/projects/9e96b11bda1844708b0809f3f8f54904/users/8bc7007e720b41a69867fedd767ea871/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:09.769773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3bb1d-7e19-42e3-92d4-76dfa81d32cb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.780073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3bb1d-7e19-42e3-92d4-76dfa81d32cb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.832674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:09.845989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3f62e-50bd-43c2-ba1d-4984445b4ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.846624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3f62e-50bd-43c2-ba1d-4984445b4ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.846948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3f62e-50bd-43c2-ba1d-4984445b4ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.847243 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3f62e-50bd-43c2-ba1d-4984445b4ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.847899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3f62e-50bd-43c2-ba1d-4984445b4ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.849981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3f62e-50bd-43c2-ba1d-4984445b4ebb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.860665 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1118/2274] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:09.865252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcfbcf-8836-429f-b9bd-180e85561f13 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:09.876543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcfbcf-8836-429f-b9bd-180e85561f13 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:09.882246 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7065b-2b36-48aa-b24e-828d37c75acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:09.882956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7065b-2b36-48aa-b24e-828d37c75acf admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.883262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7065b-2b36-48aa-b24e-828d37c75acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.883540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7065b-2b36-48aa-b24e-828d37c75acf admin admin] PATH_INFO: `/v3/projects/9e96b11bda1844708b0809f3f8f54904/users/8bc7007e720b41a69867fedd767ea871/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.885553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7065b-2b36-48aa-b24e-828d37c75acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e96b11bda1844708b0809f3f8f54904, user_id=8bc7007e720b41a69867fedd767ea871, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:09.888306 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7065b-2b36-48aa-b24e-828d37c75acf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:09.899414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1157/2275] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:09 2022] PUT /identity/v3/projects/9e96b11bda1844708b0809f3f8f54904/users/8bc7007e720b41a69867fedd767ea871/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:09.911129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1ab7-0227-4bd0-84c2-89b9a7faf20e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:09.911414 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1ab7-0227-4bd0-84c2-89b9a7faf20e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:09.911683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1ab7-0227-4bd0-84c2-89b9a7faf20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:09.940908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-021f1ab7-0227-4bd0-84c2-89b9a7faf20e None None] MFA Rules not processed for user `8bc7007e720b41a69867fedd767ea871`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:09.942111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-021f1ab7-0227-4bd0-84c2-89b9a7faf20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:10.020845 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1119/2276] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:10.032497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7065b-2b36-48aa-b24e-828d37c75acf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:10.034469 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ece7065b-2b36-48aa-b24e-828d37c75acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:10.095365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7065b-2b36-48aa-b24e-828d37c75acf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:10.101948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c84bdf-3838-4914-abcb-4cc71a9f3f9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:10.102902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c84bdf-3838-4914-abcb-4cc71a9f3f9d service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:10.103287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c84bdf-3838-4914-abcb-4cc71a9f3f9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:10.103631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c84bdf-3838-4914-abcb-4cc71a9f3f9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:10.171964 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c84bdf-3838-4914-abcb-4cc71a9f3f9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:10.173413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c84bdf-3838-4914-abcb-4cc71a9f3f9d service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:10.182605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1158/2277] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:12.063320 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f1ab7-0227-4bd0-84c2-89b9a7faf20e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:12.065244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-021f1ab7-0227-4bd0-84c2-89b9a7faf20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:12.140610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f1ab7-0227-4bd0-84c2-89b9a7faf20e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:12.145290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:12.146021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:12.146373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:12.146729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] PATH_INFO: `/v3/users/9f4efd79024a4a4380b8c75b06f0e0d2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:12.148031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4efd79024a4a4380b8c75b06f0e0d2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:12.150048 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:12.202890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4efd79024a4a4380b8c75b06f0e0d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.210379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4efd79024a4a4380b8c75b06f0e0d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.229713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4efd79024a4a4380b8c75b06f0e0d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.231594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:12.241190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4efd79024a4a4380b8c75b06f0e0d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.242981 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4efd79024a4a4380b8c75b06f0e0d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.250380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1120/2278] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:12 2022] DELETE /identity/v3/users/9f4efd79024a4a4380b8c75b06f0e0d2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:12.256173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7535bea-fe04-42b7-83d0-f44eee99fbeb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:12.256631 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7535bea-fe04-42b7-83d0-f44eee99fbeb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:12.256712 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7535bea-fe04-42b7-83d0-f44eee99fbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:12.277877 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a7535bea-fe04-42b7-83d0-f44eee99fbeb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:12.279130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a7535bea-fe04-42b7-83d0-f44eee99fbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:12.347770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1159/2279] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:30:12.357328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:12.358888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:12.429114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e28aab-9215-41d2-b4ea-5ece77b66bc5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:12.432948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2eaf9-77a2-44e7-b800-254880ab8ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:12.433608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2eaf9-77a2-44e7-b800-254880ab8ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:12.433994 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2eaf9-77a2-44e7-b800-254880ab8ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:12.434140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2eaf9-77a2-44e7-b800-254880ab8ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:12.443792 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2eaf9-77a2-44e7-b800-254880ab8ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:12.445212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2eaf9-77a2-44e7-b800-254880ab8ea8 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:12.455162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1121/2280] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:30:12.726484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7535bea-fe04-42b7-83d0-f44eee99fbeb None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:12.728068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a7535bea-fe04-42b7-83d0-f44eee99fbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:12.740722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7535bea-fe04-42b7-83d0-f44eee99fbeb None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:12.746613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:12.747316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:12.747706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:12.747985 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] PATH_INFO: `/v3/projects/9e2d6c9bc0974152a10afbd7f3d992eb` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:12.749116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2d6c9bc0974152a10afbd7f3d992eb)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:12.751052 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:12.774614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:12.811737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2d6c9bc0974152a10afbd7f3d992eb', 'request_id': 'req-53c779bb-3ba3-4926-b588-f4a2de750219'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.818940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2d6c9bc0974152a10afbd7f3d992eb', 'request_id': 'req-53c779bb-3ba3-4926-b588-f4a2de750219'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.826657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2d6c9bc0974152a10afbd7f3d992eb', 'request_id': 'req-53c779bb-3ba3-4926-b588-f4a2de750219'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.851131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] The token cache is being invalidate because project 9e2d6c9bc0974152a10afbd7f3d992eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:12.851381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.852066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:12.853709 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1160/2281] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:12 2022] DELETE /identity/v3/projects/9e2d6c9bc0974152a10afbd7f3d992eb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:12.858063 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2eaf9-77a2-44e7-b800-254880ab8ea8 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:12.869045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2eaf9-77a2-44e7-b800-254880ab8ea8 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:12.937179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:12.938159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:12.938419 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:12.938676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] PATH_INFO: `/v3/users/eadd598b252a4712a9eb22e79f161e77` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:12.939995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eadd598b252a4712a9eb22e79f161e77)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:12.941989 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:12.959282 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:12.961801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:12.978423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c779bb-3ba3-4926-b588-f4a2de750219 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:12.983401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:12.984815 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:12.985025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:12.985302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] PATH_INFO: `/v3/users/1abf455bd70e485dbac34fe04bad7a97` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:12.986532 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abf455bd70e485dbac34fe04bad7a97)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:12.988461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:12.993728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eadd598b252a4712a9eb22e79f161e77'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.001919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eadd598b252a4712a9eb22e79f161e77'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.018120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eadd598b252a4712a9eb22e79f161e77'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.026350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eadd598b252a4712a9eb22e79f161e77'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.027321 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-325d6330-0d72-4d29-8124-48e6a403c90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eadd598b252a4712a9eb22e79f161e77'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.036110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1122/2282] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:12 2022] DELETE /identity/v3/users/eadd598b252a4712a9eb22e79f161e77 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:13.046759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abf455bd70e485dbac34fe04bad7a97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.056208 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abf455bd70e485dbac34fe04bad7a97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.064236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abf455bd70e485dbac34fe04bad7a97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.064962 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abf455bd70e485dbac34fe04bad7a97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.079585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abf455bd70e485dbac34fe04bad7a97'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.085827 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1161/2283] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:12 2022] DELETE /identity/v3/users/1abf455bd70e485dbac34fe04bad7a97 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:30:13.090434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc3452-e1c0-4846-84e9-25941770706b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:13.091064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc3452-e1c0-4846-84e9-25941770706b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:13.091064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc3452-e1c0-4846-84e9-25941770706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:13.112039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-54bc3452-e1c0-4846-84e9-25941770706b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:13.113310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-54bc3452-e1c0-4846-84e9-25941770706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:13.123347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:13.213552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1123/2284] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:13.230463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:13.232023 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:13.315900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14f8eb-a144-42f5-9aae-a3ab4da85ac5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:13.320557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881e94f-b5f9-4f37-8917-9dee359be022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:13.321248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881e94f-b5f9-4f37-8917-9dee359be022 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:13.324043 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881e94f-b5f9-4f37-8917-9dee359be022 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:13.327593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881e94f-b5f9-4f37-8917-9dee359be022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:13.339263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881e94f-b5f9-4f37-8917-9dee359be022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:13.340879 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881e94f-b5f9-4f37-8917-9dee359be022 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:13.358030 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1162/2285] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:13.392984 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc3452-e1c0-4846-84e9-25941770706b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:13.394567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-54bc3452-e1c0-4846-84e9-25941770706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:13.411350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc3452-e1c0-4846-84e9-25941770706b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:13.419555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:13.420527 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:13.420907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:13.421220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] PATH_INFO: `/v3/projects/03498c8eb5d0418d916077339c757624` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:13.422515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03498c8eb5d0418d916077339c757624)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:13.424730 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:13.573999 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03498c8eb5d0418d916077339c757624', 'request_id': 'req-c8adc24c-a452-436f-a2f7-a1260ed11803'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.600168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03498c8eb5d0418d916077339c757624', 'request_id': 'req-c8adc24c-a452-436f-a2f7-a1260ed11803'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.615202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03498c8eb5d0418d916077339c757624', 'request_id': 'req-c8adc24c-a452-436f-a2f7-a1260ed11803'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.640447 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] The token cache is being invalidate because project 03498c8eb5d0418d916077339c757624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:13.641906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.642921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:13.645021 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1124/2286] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:13 2022] DELETE /identity/v3/projects/03498c8eb5d0418d916077339c757624 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:13.661046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4ed9-e839-4eb8-9bbb-01094d487221 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:13.661413 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4ed9-e839-4eb8-9bbb-01094d487221 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:13.661700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4ed9-e839-4eb8-9bbb-01094d487221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:13.701699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2acf4ed9-e839-4eb8-9bbb-01094d487221 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:13.704758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2acf4ed9-e839-4eb8-9bbb-01094d487221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:13.742444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:13.780929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:13.782395 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:13.848706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1163/2287] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:13.857874 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1503de8-7b0a-4ce1-95d5-9186e0f4ec52 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:13.858167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1503de8-7b0a-4ce1-95d5-9186e0f4ec52 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:13.858428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1503de8-7b0a-4ce1-95d5-9186e0f4ec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:13.885251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e1503de8-7b0a-4ce1-95d5-9186e0f4ec52 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:13.886524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e1503de8-7b0a-4ce1-95d5-9186e0f4ec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:13.900891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1164/2288] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:30:13.905666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1503de8-7b0a-4ce1-95d5-9186e0f4ec52 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:13.915618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1503de8-7b0a-4ce1-95d5-9186e0f4ec52 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:13.926535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc02fc-556d-43c0-aa4a-5d9088d2f803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:13.927201 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc02fc-556d-43c0-aa4a-5d9088d2f803 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:13.927477 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc02fc-556d-43c0-aa4a-5d9088d2f803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:13.927746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc02fc-556d-43c0-aa4a-5d9088d2f803 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:13.928434 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc02fc-556d-43c0-aa4a-5d9088d2f803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:30:13.928868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc02fc-556d-43c0-aa4a-5d9088d2f803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:13.930615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc02fc-556d-43c0-aa4a-5d9088d2f803 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:13.935736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adc24c-a452-436f-a2f7-a1260ed11803 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:13.941155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:13.941796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:13.942061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:13.942351 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] PATH_INFO: `/v3/projects/0a78e2d274af4dc9b32cf4b34cd1705e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:13.943685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a78e2d274af4dc9b32cf4b34cd1705e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:13.945811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:13.959255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1165/2289] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:30:13.962309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc02fc-556d-43c0-aa4a-5d9088d2f803 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:13.987994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc02fc-556d-43c0-aa4a-5d9088d2f803 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:13.996474 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e5804-871f-4689-8315-0825d0a3bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:13.998104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e5804-871f-4689-8315-0825d0a3bd86 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:13.998852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e5804-871f-4689-8315-0825d0a3bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:13.999221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e5804-871f-4689-8315-0825d0a3bd86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.000614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e5804-871f-4689-8315-0825d0a3bd86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.004183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e5804-871f-4689-8315-0825d0a3bd86 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.009572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:14.021040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a78e2d274af4dc9b32cf4b34cd1705e', 'request_id': 'req-35d41633-d9c1-4552-8c10-f53345973dc2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.033563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a78e2d274af4dc9b32cf4b34cd1705e', 'request_id': 'req-35d41633-d9c1-4552-8c10-f53345973dc2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.045777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a78e2d274af4dc9b32cf4b34cd1705e', 'request_id': 'req-35d41633-d9c1-4552-8c10-f53345973dc2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.048076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1166/2290] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:13 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:30:14.054672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e5804-871f-4689-8315-0825d0a3bd86 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.068251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] The token cache is being invalidate because project 0a78e2d274af4dc9b32cf4b34cd1705e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:14.068738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.069609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.075200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1125/2291] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:13 2022] DELETE /identity/v3/projects/0a78e2d274af4dc9b32cf4b34cd1705e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:14.076328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.078038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:14.137499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e5804-871f-4689-8315-0825d0a3bd86 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.143119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00967743-fc52-44a2-abf7-3ba1b95ac9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.143850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00967743-fc52-44a2-abf7-3ba1b95ac9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.144209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00967743-fc52-44a2-abf7-3ba1b95ac9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.144573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00967743-fc52-44a2-abf7-3ba1b95ac9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.145341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00967743-fc52-44a2-abf7-3ba1b95ac9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.147492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00967743-fc52-44a2-abf7-3ba1b95ac9b8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.175155 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d41633-d9c1-4552-8c10-f53345973dc2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.178770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1167/2292] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:14 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:14.180548 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.181272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.181450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00967743-fc52-44a2-abf7-3ba1b95ac9b8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.181577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.181883 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] PATH_INFO: `/v3/users/8bc7007e720b41a69867fedd767ea871` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.183211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc7007e720b41a69867fedd767ea871)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.184190 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-00967743-fc52-44a2-abf7-3ba1b95ac9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:14.185239 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.197613 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00967743-fc52-44a2-abf7-3ba1b95ac9b8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.205027 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad67b52-2ae8-4203-8618-8d00426306f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.205817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad67b52-2ae8-4203-8618-8d00426306f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.206095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad67b52-2ae8-4203-8618-8d00426306f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.206432 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad67b52-2ae8-4203-8618-8d00426306f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.207302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad67b52-2ae8-4203-8618-8d00426306f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.209241 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad67b52-2ae8-4203-8618-8d00426306f6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.224108 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1168/2293] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:30:14.225024 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad67b52-2ae8-4203-8618-8d00426306f6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.235873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad67b52-2ae8-4203-8618-8d00426306f6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.244310 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89297f-5f0b-4981-a664-f07a20e31349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.245070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89297f-5f0b-4981-a664-f07a20e31349 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.245191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89297f-5f0b-4981-a664-f07a20e31349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.245439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89297f-5f0b-4981-a664-f07a20e31349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.246212 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89297f-5f0b-4981-a664-f07a20e31349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.248017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89297f-5f0b-4981-a664-f07a20e31349 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.260083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc7007e720b41a69867fedd767ea871'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.261793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1169/2294] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:14.265779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89297f-5f0b-4981-a664-f07a20e31349 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.269463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc7007e720b41a69867fedd767ea871'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.279276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89297f-5f0b-4981-a664-f07a20e31349 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.283061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc7007e720b41a69867fedd767ea871'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.284581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d286e4-15ea-47c2-b0c9-c6b1241822f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.285253 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d286e4-15ea-47c2-b0c9-c6b1241822f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.285587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d286e4-15ea-47c2-b0c9-c6b1241822f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.285868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d286e4-15ea-47c2-b0c9-c6b1241822f1 admin admin] PATH_INFO: `/v3/projects/abe44575a071473a9fcc05dbb9aae7dd/users/8788321698fd4ab5960ba03aa7da8473/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.293467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc7007e720b41a69867fedd767ea871'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.294278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a62e0dac-3191-4cd2-aae9-5f76a4c07c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc7007e720b41a69867fedd767ea871'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.303764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1126/2295] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:14 2022] DELETE /identity/v3/users/8bc7007e720b41a69867fedd767ea871 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:14.306961 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d286e4-15ea-47c2-b0c9-c6b1241822f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe44575a071473a9fcc05dbb9aae7dd, user_id=8788321698fd4ab5960ba03aa7da8473, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.311622 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d286e4-15ea-47c2-b0c9-c6b1241822f1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.328392 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1170/2296] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:14 2022] PUT /identity/v3/projects/abe44575a071473a9fcc05dbb9aae7dd/users/8788321698fd4ab5960ba03aa7da8473/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:30:14.339003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d279-e816-4b28-a92b-a7e85921b34a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.339278 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d279-e816-4b28-a92b-a7e85921b34a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.339607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d279-e816-4b28-a92b-a7e85921b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.374627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7511d279-e816-4b28-a92b-a7e85921b34a None None] MFA Rules not processed for user `8788321698fd4ab5960ba03aa7da8473`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:14.376034 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7511d279-e816-4b28-a92b-a7e85921b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:14.418909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:14.461701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1127/2297] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:14.466387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d286e4-15ea-47c2-b0c9-c6b1241822f1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.469204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-22d286e4-15ea-47c2-b0c9-c6b1241822f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:14.509211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:14.556753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d286e4-15ea-47c2-b0c9-c6b1241822f1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.562672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d167765-6974-45c3-9df6-973437b369a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.563504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167765-6974-45c3-9df6-973437b369a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.563796 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167765-6974-45c3-9df6-973437b369a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.564203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167765-6974-45c3-9df6-973437b369a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.565183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d167765-6974-45c3-9df6-973437b369a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.567542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d167765-6974-45c3-9df6-973437b369a6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.600479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1171/2298] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:14 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:14.604571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d279-e816-4b28-a92b-a7e85921b34a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.617664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d279-e816-4b28-a92b-a7e85921b34a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.637941 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d167765-6974-45c3-9df6-973437b369a6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.641071 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7d167765-6974-45c3-9df6-973437b369a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:14.704263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb7eaa-f25e-4a8a-8d04-c8399aa00941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.704883 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb7eaa-f25e-4a8a-8d04-c8399aa00941 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.705197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb7eaa-f25e-4a8a-8d04-c8399aa00941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.705474 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb7eaa-f25e-4a8a-8d04-c8399aa00941 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.706113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb7eaa-f25e-4a8a-8d04-c8399aa00941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.708078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb7eaa-f25e-4a8a-8d04-c8399aa00941 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.718678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d167765-6974-45c3-9df6-973437b369a6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.724657 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436416f-5269-4336-9a07-415978852417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.725423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436416f-5269-4336-9a07-415978852417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.726358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436416f-5269-4336-9a07-415978852417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.726358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436416f-5269-4336-9a07-415978852417 admin admin] PATH_INFO: `/v3/projects/9e96b11bda1844708b0809f3f8f54904` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.727977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436416f-5269-4336-9a07-415978852417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e96b11bda1844708b0809f3f8f54904)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.730084 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436416f-5269-4336-9a07-415978852417 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.734214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1128/2299] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:14 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:30:14.738743 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb7eaa-f25e-4a8a-8d04-c8399aa00941 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.750998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb7eaa-f25e-4a8a-8d04-c8399aa00941 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.756500 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520d771-2728-4ede-bb27-59031580282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.757117 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520d771-2728-4ede-bb27-59031580282f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.757460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520d771-2728-4ede-bb27-59031580282f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.757721 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520d771-2728-4ede-bb27-59031580282f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.758373 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520d771-2728-4ede-bb27-59031580282f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.760165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520d771-2728-4ede-bb27-59031580282f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.774950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1129/2300] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:30:14.776927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520d771-2728-4ede-bb27-59031580282f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.787146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520d771-2728-4ede-bb27-59031580282f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.791719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1436416f-5269-4336-9a07-415978852417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e96b11bda1844708b0809f3f8f54904', 'request_id': 'req-1436416f-5269-4336-9a07-415978852417'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.798080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1436416f-5269-4336-9a07-415978852417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e96b11bda1844708b0809f3f8f54904', 'request_id': 'req-1436416f-5269-4336-9a07-415978852417'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.805178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1436416f-5269-4336-9a07-415978852417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e96b11bda1844708b0809f3f8f54904', 'request_id': 'req-1436416f-5269-4336-9a07-415978852417'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.824478 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1436416f-5269-4336-9a07-415978852417 admin admin] The token cache is being invalidate because project 9e96b11bda1844708b0809f3f8f54904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:14.824797 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1436416f-5269-4336-9a07-415978852417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.825528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1436416f-5269-4336-9a07-415978852417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:14.827409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1172/2301] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:14 2022] DELETE /identity/v3/projects/9e96b11bda1844708b0809f3f8f54904 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:14.834172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad2cba-0a8d-4aac-9d9c-17110617d417 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.834508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad2cba-0a8d-4aac-9d9c-17110617d417 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.834811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad2cba-0a8d-4aac-9d9c-17110617d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.861140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69544209-461a-4d74-b281-726af293a572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.862135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69544209-461a-4d74-b281-726af293a572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.862448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69544209-461a-4d74-b281-726af293a572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.862863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69544209-461a-4d74-b281-726af293a572 admin admin] PATH_INFO: `/v3/projects/1df18fe5084544da9a407d374fdac99d/users/03d52e55fbf14452b93cd2a85a45ae12/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.863830 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-47ad2cba-0a8d-4aac-9d9c-17110617d417 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:14.865126 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-47ad2cba-0a8d-4aac-9d9c-17110617d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:14.879926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69544209-461a-4d74-b281-726af293a572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df18fe5084544da9a407d374fdac99d, user_id=03d52e55fbf14452b93cd2a85a45ae12, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.882820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69544209-461a-4d74-b281-726af293a572 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:14.882971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1173/2302] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:14.887534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037685c8-3643-4f20-97ed-d0d8a556d29c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.888021 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037685c8-3643-4f20-97ed-d0d8a556d29c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.888299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037685c8-3643-4f20-97ed-d0d8a556d29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.897995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1130/2303] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:14 2022] PUT /identity/v3/projects/1df18fe5084544da9a407d374fdac99d/users/03d52e55fbf14452b93cd2a85a45ae12/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:14.902534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69544209-461a-4d74-b281-726af293a572 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:14.904336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-69544209-461a-4d74-b281-726af293a572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:14.914447 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-037685c8-3643-4f20-97ed-d0d8a556d29c None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:14.916564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-037685c8-3643-4f20-97ed-d0d8a556d29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:14.952062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:14.966854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:14.977794 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69544209-461a-4d74-b281-726af293a572 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:14.982700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8b10b-e6b3-4605-9cd2-e01abb4a5c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:14.983346 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8b10b-e6b3-4605-9cd2-e01abb4a5c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:14.983624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8b10b-e6b3-4605-9cd2-e01abb4a5c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:14.983894 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8b10b-e6b3-4605-9cd2-e01abb4a5c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:14.984536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8b10b-e6b3-4605-9cd2-e01abb4a5c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:14.986162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8b10b-e6b3-4605-9cd2-e01abb4a5c94 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.000666 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1131/2304] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:30:15.001563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8b10b-e6b3-4605-9cd2-e01abb4a5c94 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.009444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1174/2305] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:30:15.011676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8b10b-e6b3-4605-9cd2-e01abb4a5c94 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.013242 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037685c8-3643-4f20-97ed-d0d8a556d29c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.016809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401822d-46d8-4239-9f20-f38c4a863ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.017470 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401822d-46d8-4239-9f20-f38c4a863ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.017809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401822d-46d8-4239-9f20-f38c4a863ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.018200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401822d-46d8-4239-9f20-f38c4a863ad7 admin admin] PATH_INFO: `/v3/projects/1df18fe5084544da9a407d374fdac99d/users/03d52e55fbf14452b93cd2a85a45ae12/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.020175 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401822d-46d8-4239-9f20-f38c4a863ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df18fe5084544da9a407d374fdac99d, user_id=03d52e55fbf14452b93cd2a85a45ae12, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.022832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401822d-46d8-4239-9f20-f38c4a863ad7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.023439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037685c8-3643-4f20-97ed-d0d8a556d29c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.028011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde2bf5-4734-491e-88eb-19ea8f5aa703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.029075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde2bf5-4734-491e-88eb-19ea8f5aa703 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.029075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde2bf5-4734-491e-88eb-19ea8f5aa703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.029286 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde2bf5-4734-491e-88eb-19ea8f5aa703 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.029813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde2bf5-4734-491e-88eb-19ea8f5aa703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:30:15.030118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde2bf5-4734-491e-88eb-19ea8f5aa703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.031785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde2bf5-4734-491e-88eb-19ea8f5aa703 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.035260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1132/2306] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:15 2022] PUT /identity/v3/projects/1df18fe5084544da9a407d374fdac99d/users/03d52e55fbf14452b93cd2a85a45ae12/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:15.046601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29b003-82c4-4c04-b559-9497dc4fd261 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.046601 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29b003-82c4-4c04-b559-9497dc4fd261 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.046950 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29b003-82c4-4c04-b559-9497dc4fd261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.047337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1175/2307] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:30:15.048210 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde2bf5-4734-491e-88eb-19ea8f5aa703 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.060751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde2bf5-4734-491e-88eb-19ea8f5aa703 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.079275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ea29b003-82c4-4c04-b559-9497dc4fd261 None None] MFA Rules not processed for user `03d52e55fbf14452b93cd2a85a45ae12`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:15.080727 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ea29b003-82c4-4c04-b559-9497dc4fd261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:15.126161 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692145ad-f63b-4a47-b908-4e7353079cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.127398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692145ad-f63b-4a47-b908-4e7353079cff admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.127686 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692145ad-f63b-4a47-b908-4e7353079cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.127960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692145ad-f63b-4a47-b908-4e7353079cff admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.128999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692145ad-f63b-4a47-b908-4e7353079cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.131514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692145ad-f63b-4a47-b908-4e7353079cff admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.163286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1133/2308] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:30:15.164322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1176/2309] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:15 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:15.168921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29b003-82c4-4c04-b559-9497dc4fd261 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.173603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692145ad-f63b-4a47-b908-4e7353079cff admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.176265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-692145ad-f63b-4a47-b908-4e7353079cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:15.180046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29b003-82c4-4c04-b559-9497dc4fd261 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.237280 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692145ad-f63b-4a47-b908-4e7353079cff admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.241189 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4e2c1-fdc9-4166-a12e-5eca1e84fa93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.242289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4e2c1-fdc9-4166-a12e-5eca1e84fa93 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.242707 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4e2c1-fdc9-4166-a12e-5eca1e84fa93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.243017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4e2c1-fdc9-4166-a12e-5eca1e84fa93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.243396 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96cf12-6f26-424f-a01f-afa7a54e1914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.244024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96cf12-6f26-424f-a01f-afa7a54e1914 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.244301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96cf12-6f26-424f-a01f-afa7a54e1914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.244993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96cf12-6f26-424f-a01f-afa7a54e1914 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.245637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96cf12-6f26-424f-a01f-afa7a54e1914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.247897 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96cf12-6f26-424f-a01f-afa7a54e1914 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.277224 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1134/2310] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:15 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:15.281298 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96cf12-6f26-424f-a01f-afa7a54e1914 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.291260 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96cf12-6f26-424f-a01f-afa7a54e1914 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.295918 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21556e-73e0-4fea-b7f4-506eacc6b65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.296520 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21556e-73e0-4fea-b7f4-506eacc6b65e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.296803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21556e-73e0-4fea-b7f4-506eacc6b65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.297075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21556e-73e0-4fea-b7f4-506eacc6b65e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.297728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21556e-73e0-4fea-b7f4-506eacc6b65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.299863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21556e-73e0-4fea-b7f4-506eacc6b65e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.311538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1135/2311] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:30:15.315647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:15.316075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21556e-73e0-4fea-b7f4-506eacc6b65e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.318436 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4e2c1-fdc9-4166-a12e-5eca1e84fa93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.320081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4e2c1-fdc9-4166-a12e-5eca1e84fa93 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.329181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21556e-73e0-4fea-b7f4-506eacc6b65e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.334312 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d13e42-6c50-4309-9265-9288206016a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.334893 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1177/2312] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:30:15.335349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13e42-6c50-4309-9265-9288206016a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.335596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13e42-6c50-4309-9265-9288206016a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.336281 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13e42-6c50-4309-9265-9288206016a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.336534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d13e42-6c50-4309-9265-9288206016a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.338134 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d13e42-6c50-4309-9265-9288206016a6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.350996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1136/2313] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:30:15.357875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4e2c1-fdc9-4166-a12e-5eca1e84fa93 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.370585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4e2c1-fdc9-4166-a12e-5eca1e84fa93 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.375543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f3ebe-2f74-4f32-8099-1f9b5ad8dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.376219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3ebe-2f74-4f32-8099-1f9b5ad8dcae admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.376499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3ebe-2f74-4f32-8099-1f9b5ad8dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.376936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3ebe-2f74-4f32-8099-1f9b5ad8dcae admin admin] PATH_INFO: `/v3/projects/48e8489c58ce47719a623bd9974dca94/users/c203d16777684fc89dda845c5b0846fa/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.380617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4daf2-a798-4a3f-ac3f-f21e3fc5d97b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.380902 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4daf2-a798-4a3f-ac3f-f21e3fc5d97b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.381179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4daf2-a798-4a3f-ac3f-f21e3fc5d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.396375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f3ebe-2f74-4f32-8099-1f9b5ad8dcae admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e8489c58ce47719a623bd9974dca94, user_id=c203d16777684fc89dda845c5b0846fa, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.400082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f3ebe-2f74-4f32-8099-1f9b5ad8dcae admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.409663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c9e4daf2-a798-4a3f-ac3f-f21e3fc5d97b None None] MFA Rules not processed for user `cdaa7f35aa2a45d7acfc9a00d63a6d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:15.411064 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9e4daf2-a798-4a3f-ac3f-f21e3fc5d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:15.416577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1178/2314] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:15 2022] PUT /identity/v3/projects/48e8489c58ce47719a623bd9974dca94/users/c203d16777684fc89dda845c5b0846fa/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:15.425626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:15.427317 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd34bed-85b2-42a0-8496-34d1fa3347ae None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.427609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd34bed-85b2-42a0-8496-34d1fa3347ae None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.427884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd34bed-85b2-42a0-8496-34d1fa3347ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.471107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0dd34bed-85b2-42a0-8496-34d1fa3347ae None None] MFA Rules not processed for user `c203d16777684fc89dda845c5b0846fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:15.472461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0dd34bed-85b2-42a0-8496-34d1fa3347ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:15.481579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1137/2315] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:30:15.545151 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1179/2316] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:15.555952 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4daf2-a798-4a3f-ac3f-f21e3fc5d97b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.557647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9e4daf2-a798-4a3f-ac3f-f21e3fc5d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:15.633070 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4daf2-a798-4a3f-ac3f-f21e3fc5d97b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.638043 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca0d15-9c8f-4bb3-b2c0-49b795a00c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.638586 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca0d15-9c8f-4bb3-b2c0-49b795a00c2b service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.639378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca0d15-9c8f-4bb3-b2c0-49b795a00c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.640519 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca0d15-9c8f-4bb3-b2c0-49b795a00c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.648889 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca0d15-9c8f-4bb3-b2c0-49b795a00c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.650573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca0d15-9c8f-4bb3-b2c0-49b795a00c2b service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.660444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1138/2317] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:15.841563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd34bed-85b2-42a0-8496-34d1fa3347ae None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:15.843115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0dd34bed-85b2-42a0-8496-34d1fa3347ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:15.918498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd34bed-85b2-42a0-8496-34d1fa3347ae None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:15.922640 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a420b-c5a8-411a-8198-ffc56fbb7787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:15.923509 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a420b-c5a8-411a-8198-ffc56fbb7787 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:15.923816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a420b-c5a8-411a-8198-ffc56fbb7787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:15.924086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a420b-c5a8-411a-8198-ffc56fbb7787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:15.926142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bc3a420b-c5a8-411a-8198-ffc56fbb7787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:15.937590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a420b-c5a8-411a-8198-ffc56fbb7787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:15.939258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a420b-c5a8-411a-8198-ffc56fbb7787 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:15.953328 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1180/2318] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:30:16.895561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca0d15-9c8f-4bb3-b2c0-49b795a00c2b service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:16.961136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca0d15-9c8f-4bb3-b2c0-49b795a00c2b service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:16.965942 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:16.966584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:16.966891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:16.967161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] PATH_INFO: `/v3/users/8788321698fd4ab5960ba03aa7da8473` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:16.968275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] RBAC: Authorizing `identity:delete_user(user_id=8788321698fd4ab5960ba03aa7da8473)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:16.970188 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:17.022496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8788321698fd4ab5960ba03aa7da8473'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.029245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8788321698fd4ab5960ba03aa7da8473'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.034784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:17.043216 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8788321698fd4ab5960ba03aa7da8473'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.052410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8788321698fd4ab5960ba03aa7da8473'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.053186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8788321698fd4ab5960ba03aa7da8473'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.059834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1139/2319] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:16 2022] DELETE /identity/v3/users/8788321698fd4ab5960ba03aa7da8473 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:17.064440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a658bd-a49d-4080-ae13-b7e6034f1c97 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:17.064912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a658bd-a49d-4080-ae13-b7e6034f1c97 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:17.065005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a658bd-a49d-4080-ae13-b7e6034f1c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:17.084802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a9a658bd-a49d-4080-ae13-b7e6034f1c97 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:17.086095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a9a658bd-a49d-4080-ae13-b7e6034f1c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:17.148713 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1181/2320] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:17.158759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:17.160262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:17.220866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01209345-6cab-4210-825a-d61d04e431da admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:17.224494 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bff353-0f9a-447f-a19b-2eed6edd43eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:17.225109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bff353-0f9a-447f-a19b-2eed6edd43eb service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:17.225503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bff353-0f9a-447f-a19b-2eed6edd43eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:17.225778 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bff353-0f9a-447f-a19b-2eed6edd43eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:17.234998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bff353-0f9a-447f-a19b-2eed6edd43eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:17.236471 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bff353-0f9a-447f-a19b-2eed6edd43eb service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:17.246766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1140/2321] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:17.611080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a658bd-a49d-4080-ae13-b7e6034f1c97 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:17.612779 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a9a658bd-a49d-4080-ae13-b7e6034f1c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:17.621643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:17.628590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a658bd-a49d-4080-ae13-b7e6034f1c97 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:17.647062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:17.647731 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:17.648008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:17.648280 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] PATH_INFO: `/v3/projects/abe44575a071473a9fcc05dbb9aae7dd` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:17.649405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe44575a071473a9fcc05dbb9aae7dd)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:17.651489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:17.701897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe44575a071473a9fcc05dbb9aae7dd', 'request_id': 'req-59b512ce-c1be-4a09-a4b5-89743a98ef34'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.707531 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe44575a071473a9fcc05dbb9aae7dd', 'request_id': 'req-59b512ce-c1be-4a09-a4b5-89743a98ef34'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.714046 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe44575a071473a9fcc05dbb9aae7dd', 'request_id': 'req-59b512ce-c1be-4a09-a4b5-89743a98ef34'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.731836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] The token cache is being invalidate because project abe44575a071473a9fcc05dbb9aae7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:17.732132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.732758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.734340 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1182/2322] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:17 2022] DELETE /identity/v3/projects/abe44575a071473a9fcc05dbb9aae7dd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:17.738583 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bff353-0f9a-447f-a19b-2eed6edd43eb service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:17.752928 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bff353-0f9a-447f-a19b-2eed6edd43eb service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:17.810115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:17.810827 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:17.811165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:17.811444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] PATH_INFO: `/v3/users/03d52e55fbf14452b93cd2a85a45ae12` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:17.812632 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d52e55fbf14452b93cd2a85a45ae12)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:17.814634 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:17.871001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d52e55fbf14452b93cd2a85a45ae12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.877758 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d52e55fbf14452b93cd2a85a45ae12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.890206 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d52e55fbf14452b93cd2a85a45ae12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.900173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d52e55fbf14452b93cd2a85a45ae12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.900852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6ad3fce5-244c-4b7b-b559-c09939c52ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d52e55fbf14452b93cd2a85a45ae12'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:17.908044 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1141/2323] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:17 2022] DELETE /identity/v3/users/03d52e55fbf14452b93cd2a85a45ae12 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:18.181994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:18.183618 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:18.197794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b512ce-c1be-4a09-a4b5-89743a98ef34 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:18.294334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:18.295038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.295321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.295599 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] PATH_INFO: `/v3/projects/1df18fe5084544da9a407d374fdac99d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:18.296759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df18fe5084544da9a407d374fdac99d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:18.298840 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:18.354585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df18fe5084544da9a407d374fdac99d', 'request_id': 'req-03e8ad53-242e-4a81-a633-56c6cc78ddd7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:18.360578 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df18fe5084544da9a407d374fdac99d', 'request_id': 'req-03e8ad53-242e-4a81-a633-56c6cc78ddd7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:18.368998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df18fe5084544da9a407d374fdac99d', 'request_id': 'req-03e8ad53-242e-4a81-a633-56c6cc78ddd7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:18.384230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] The token cache is being invalidate because project 1df18fe5084544da9a407d374fdac99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:18.384646 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:18.385409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-03e8ad53-242e-4a81-a633-56c6cc78ddd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:18.388477 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1183/2324] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:18 2022] DELETE /identity/v3/projects/1df18fe5084544da9a407d374fdac99d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:30:18.392148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4891ccf-d872-4807-82bd-ed81818b0eeb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.392508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4891ccf-d872-4807-82bd-ed81818b0eeb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.392796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4891ccf-d872-4807-82bd-ed81818b0eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:18.401197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:18.417383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a4891ccf-d872-4807-82bd-ed81818b0eeb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:18.419263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a4891ccf-d872-4807-82bd-ed81818b0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:18.478245 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1142/2325] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:18.486079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07c3db-1ea8-4d39-a943-0c86918e5fe5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.486401 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07c3db-1ea8-4d39-a943-0c86918e5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.486677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07c3db-1ea8-4d39-a943-0c86918e5fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:18.509821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2d07c3db-1ea8-4d39-a943-0c86918e5fe5 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:18.510701 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2d07c3db-1ea8-4d39-a943-0c86918e5fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:18.546527 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1184/2326] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:18.547475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4891ccf-d872-4807-82bd-ed81818b0eeb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:18.563046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4891ccf-d872-4807-82bd-ed81818b0eeb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:18.579649 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c518fca-21d2-40e3-9a85-e158e71a31c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:18.580379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c518fca-21d2-40e3-9a85-e158e71a31c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.580664 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c518fca-21d2-40e3-9a85-e158e71a31c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.580932 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c518fca-21d2-40e3-9a85-e158e71a31c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:18.581626 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c518fca-21d2-40e3-9a85-e158e71a31c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:30:18.582119 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c518fca-21d2-40e3-9a85-e158e71a31c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:18.583887 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c518fca-21d2-40e3-9a85-e158e71a31c6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:18.601251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1143/2327] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:30:18.604768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07c3db-1ea8-4d39-a943-0c86918e5fe5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:18.614358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07c3db-1ea8-4d39-a943-0c86918e5fe5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:18.619668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5700-b2e3-421c-9e38-718be40ea266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:18.620439 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5700-b2e3-421c-9e38-718be40ea266 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.620721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5700-b2e3-421c-9e38-718be40ea266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.620996 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5700-b2e3-421c-9e38-718be40ea266 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:18.621654 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d5700-b2e3-421c-9e38-718be40ea266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:18.624120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d5700-b2e3-421c-9e38-718be40ea266 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:18.635607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:18.672360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c518fca-21d2-40e3-9a85-e158e71a31c6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:18.673703 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1185/2328] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:18 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:18.683627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c518fca-21d2-40e3-9a85-e158e71a31c6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:18.752811 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69a5d9-ec37-4856-9990-d27ca463c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:18.753383 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69a5d9-ec37-4856-9990-d27ca463c72a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.753623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69a5d9-ec37-4856-9990-d27ca463c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.753901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69a5d9-ec37-4856-9990-d27ca463c72a admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:18.754837 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69a5d9-ec37-4856-9990-d27ca463c72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:18.757139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69a5d9-ec37-4856-9990-d27ca463c72a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:18.802220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1144/2329] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:18 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:30:18.803648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5700-b2e3-421c-9e38-718be40ea266 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:18.816890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5700-b2e3-421c-9e38-718be40ea266 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:18.825031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0b742-2ee5-4fba-bf4e-993be62e4606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:18.826807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0b742-2ee5-4fba-bf4e-993be62e4606 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.826807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0b742-2ee5-4fba-bf4e-993be62e4606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.826807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0b742-2ee5-4fba-bf4e-993be62e4606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:18.827167 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0b742-2ee5-4fba-bf4e-993be62e4606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:18.828678 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0b742-2ee5-4fba-bf4e-993be62e4606 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:18.845083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1186/2330] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:30:18.846891 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69a5d9-ec37-4856-9990-d27ca463c72a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:18.857951 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69a5d9-ec37-4856-9990-d27ca463c72a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:18.863137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900153fc-2527-4b49-8452-734f6b541fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:18.863833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900153fc-2527-4b49-8452-734f6b541fef admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.864284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900153fc-2527-4b49-8452-734f6b541fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.865114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900153fc-2527-4b49-8452-734f6b541fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:18.865627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900153fc-2527-4b49-8452-734f6b541fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:18.867638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900153fc-2527-4b49-8452-734f6b541fef admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:18.885484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1145/2331] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:18.889500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0b742-2ee5-4fba-bf4e-993be62e4606 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:18.900928 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0b742-2ee5-4fba-bf4e-993be62e4606 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:18.907834 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18426727-fd30-4681-849c-26bcab96a5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:18.908643 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18426727-fd30-4681-849c-26bcab96a5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.908948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18426727-fd30-4681-849c-26bcab96a5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.909247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18426727-fd30-4681-849c-26bcab96a5e7 admin admin] PATH_INFO: `/v3/projects/6b15ba9a5f1545e09f3f606a881c1cf0/users/52a15b8a08f549e18e8884fefaccbb7c/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:18.928028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18426727-fd30-4681-849c-26bcab96a5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b15ba9a5f1545e09f3f606a881c1cf0, user_id=52a15b8a08f549e18e8884fefaccbb7c, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:18.930937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18426727-fd30-4681-849c-26bcab96a5e7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:18.951992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1187/2332] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:18 2022] PUT /identity/v3/projects/6b15ba9a5f1545e09f3f606a881c1cf0/users/52a15b8a08f549e18e8884fefaccbb7c/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:18.963266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c342-7ed5-4be5-9e4e-f62db7687274 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:18.963749 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c342-7ed5-4be5-9e4e-f62db7687274 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:18.963927 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c342-7ed5-4be5-9e4e-f62db7687274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:19.010404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c419c342-7ed5-4be5-9e4e-f62db7687274 None None] MFA Rules not processed for user `52a15b8a08f549e18e8884fefaccbb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:19.012178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c419c342-7ed5-4be5-9e4e-f62db7687274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:19.085027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:19.091142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1146/2333] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:19.095775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18426727-fd30-4681-849c-26bcab96a5e7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:19.174225 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18426727-fd30-4681-849c-26bcab96a5e7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:19.179387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0069d-95db-4768-b565-11626d98626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:19.180015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0069d-95db-4768-b565-11626d98626f admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:19.180299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0069d-95db-4768-b565-11626d98626f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:19.180667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0069d-95db-4768-b565-11626d98626f admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:19.181324 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0069d-95db-4768-b565-11626d98626f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:19.183823 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0069d-95db-4768-b565-11626d98626f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:19.213138 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1188/2334] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:19 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:30:19.219013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c342-7ed5-4be5-9e4e-f62db7687274 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:19.229760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c342-7ed5-4be5-9e4e-f62db7687274 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:19.289143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d53c-fb50-462d-874d-5b60b75dc773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:19.289764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d53c-fb50-462d-874d-5b60b75dc773 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:19.290039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d53c-fb50-462d-874d-5b60b75dc773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:19.290308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d53c-fb50-462d-874d-5b60b75dc773 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:19.291031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22d53c-fb50-462d-874d-5b60b75dc773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:19.292997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22d53c-fb50-462d-874d-5b60b75dc773 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:19.313678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1147/2335] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:19 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:19.317814 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0069d-95db-4768-b565-11626d98626f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:19.328575 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0069d-95db-4768-b565-11626d98626f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:19.333647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71df63a-3e96-43f0-b050-297623bab9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:19.334258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71df63a-3e96-43f0-b050-297623bab9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:19.334538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71df63a-3e96-43f0-b050-297623bab9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:19.334843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71df63a-3e96-43f0-b050-297623bab9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:19.335515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71df63a-3e96-43f0-b050-297623bab9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:19.337089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71df63a-3e96-43f0-b050-297623bab9ce admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:19.349069 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1189/2336] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:19.353388 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d53c-fb50-462d-874d-5b60b75dc773 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:19.364250 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d53c-fb50-462d-874d-5b60b75dc773 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:19.371120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01987861-7e24-44a5-b0c6-b0245b7b3c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:19.371801 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01987861-7e24-44a5-b0c6-b0245b7b3c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:19.372071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01987861-7e24-44a5-b0c6-b0245b7b3c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:19.372355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01987861-7e24-44a5-b0c6-b0245b7b3c4c admin admin] PATH_INFO: `/v3/projects/c11901841336496795a5892b3eab5c48/users/85f2e38b97124256b6a2c8d57c513f54/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:19.388824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01987861-7e24-44a5-b0c6-b0245b7b3c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11901841336496795a5892b3eab5c48, user_id=85f2e38b97124256b6a2c8d57c513f54, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:19.391672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01987861-7e24-44a5-b0c6-b0245b7b3c4c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:19.405990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1148/2337] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:19 2022] PUT /identity/v3/projects/c11901841336496795a5892b3eab5c48/users/85f2e38b97124256b6a2c8d57c513f54/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:19.410187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71df63a-3e96-43f0-b050-297623bab9ce admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:19.420445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71df63a-3e96-43f0-b050-297623bab9ce admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:19.482732 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8d45d-1704-4449-b58f-5877743adb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:19.483384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d45d-1704-4449-b58f-5877743adb3d admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:19.483647 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d45d-1704-4449-b58f-5877743adb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:19.483921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d45d-1704-4449-b58f-5877743adb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:19.484577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8d45d-1704-4449-b58f-5877743adb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:19.486277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8d45d-1704-4449-b58f-5877743adb3d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:19.496911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1190/2338] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:19.501129 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01987861-7e24-44a5-b0c6-b0245b7b3c4c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:19.511591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01987861-7e24-44a5-b0c6-b0245b7b3c4c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:19.516304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214defdb-90eb-429d-a45a-6d3e1b4dae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:19.516969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214defdb-90eb-429d-a45a-6d3e1b4dae3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:19.517241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214defdb-90eb-429d-a45a-6d3e1b4dae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:19.517573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214defdb-90eb-429d-a45a-6d3e1b4dae3e admin admin] PATH_INFO: `/v3/projects/c11901841336496795a5892b3eab5c48/users/85f2e38b97124256b6a2c8d57c513f54/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:19.519517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214defdb-90eb-429d-a45a-6d3e1b4dae3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11901841336496795a5892b3eab5c48, user_id=85f2e38b97124256b6a2c8d57c513f54, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:19.522135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214defdb-90eb-429d-a45a-6d3e1b4dae3e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:19.532646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1149/2339] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:19 2022] PUT /identity/v3/projects/c11901841336496795a5892b3eab5c48/users/85f2e38b97124256b6a2c8d57c513f54/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:19.543891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f717-05a0-40b2-b48e-d23e0dfc94a3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:19.544164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f717-05a0-40b2-b48e-d23e0dfc94a3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:19.544437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f717-05a0-40b2-b48e-d23e0dfc94a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:19.573272 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5b20f717-05a0-40b2-b48e-d23e0dfc94a3 None None] MFA Rules not processed for user `85f2e38b97124256b6a2c8d57c513f54`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:19.574499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5b20f717-05a0-40b2-b48e-d23e0dfc94a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:19.588341 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:19.647844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1191/2340] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:19.660004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214defdb-90eb-429d-a45a-6d3e1b4dae3e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:19.661720 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-214defdb-90eb-429d-a45a-6d3e1b4dae3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:19.722674 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214defdb-90eb-429d-a45a-6d3e1b4dae3e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:19.727194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24436ca-d4aa-4071-9f0d-46ebdd604d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:19.727836 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24436ca-d4aa-4071-9f0d-46ebdd604d07 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:19.728114 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24436ca-d4aa-4071-9f0d-46ebdd604d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:19.728391 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24436ca-d4aa-4071-9f0d-46ebdd604d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:19.789647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24436ca-d4aa-4071-9f0d-46ebdd604d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:19.791140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24436ca-d4aa-4071-9f0d-46ebdd604d07 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:19.802200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1150/2341] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:22.452692 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20f717-05a0-40b2-b48e-d23e0dfc94a3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:22.470794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20f717-05a0-40b2-b48e-d23e0dfc94a3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:22.475523 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f78d7d-c696-42b4-926e-7d1cee95de3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:22.476219 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f78d7d-c696-42b4-926e-7d1cee95de3d service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:22.476559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f78d7d-c696-42b4-926e-7d1cee95de3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:22.476896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f78d7d-c696-42b4-926e-7d1cee95de3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:22.487542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f78d7d-c696-42b4-926e-7d1cee95de3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:22.489122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f78d7d-c696-42b4-926e-7d1cee95de3d service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:22.500535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1192/2342] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:24.813509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24436ca-d4aa-4071-9f0d-46ebdd604d07 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:24.815092 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b24436ca-d4aa-4071-9f0d-46ebdd604d07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:24.823554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:24.920384 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24436ca-d4aa-4071-9f0d-46ebdd604d07 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:24.926780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31b658-a016-4423-977e-19e101c6a3c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:24.927453 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31b658-a016-4423-977e-19e101c6a3c9 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:24.927734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31b658-a016-4423-977e-19e101c6a3c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:24.928001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31b658-a016-4423-977e-19e101c6a3c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:24.929827 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7c31b658-a016-4423-977e-19e101c6a3c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:24.942161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31b658-a016-4423-977e-19e101c6a3c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:24.943775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31b658-a016-4423-977e-19e101c6a3c9 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:24.954168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1151/2343] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:25.915534 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f78d7d-c696-42b4-926e-7d1cee95de3d service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:25.917102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-55f78d7d-c696-42b4-926e-7d1cee95de3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:25.983245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f78d7d-c696-42b4-926e-7d1cee95de3d service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:25.988762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:25.989404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:25.989680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:25.989981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] PATH_INFO: `/v3/users/c203d16777684fc89dda845c5b0846fa` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:25.991733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c203d16777684fc89dda845c5b0846fa)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:25.993737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:26.043358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c203d16777684fc89dda845c5b0846fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.052085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c203d16777684fc89dda845c5b0846fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.059662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c203d16777684fc89dda845c5b0846fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.060560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c203d16777684fc89dda845c5b0846fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.072810 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c203d16777684fc89dda845c5b0846fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.079213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1193/2344] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:25 2022] DELETE /identity/v3/users/c203d16777684fc89dda845c5b0846fa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:26.083801 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acbdeb-50cd-423e-9f85-ea7995972a08 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:26.084283 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acbdeb-50cd-423e-9f85-ea7995972a08 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:26.084375 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acbdeb-50cd-423e-9f85-ea7995972a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:26.104413 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a4acbdeb-50cd-423e-9f85-ea7995972a08 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:26.105553 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a4acbdeb-50cd-423e-9f85-ea7995972a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:26.165089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1152/2345] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:26.175460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:26.176999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:26.197162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:26.239846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0eb31-b825-4ab4-a65f-fa4f4d9c5b56 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:26.244598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656e583-b4c7-4d11-a34c-a0538732832d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:26.245233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656e583-b4c7-4d11-a34c-a0538732832d service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:26.245521 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656e583-b4c7-4d11-a34c-a0538732832d service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:26.245822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656e583-b4c7-4d11-a34c-a0538732832d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:26.255395 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656e583-b4c7-4d11-a34c-a0538732832d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:26.256832 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656e583-b4c7-4d11-a34c-a0538732832d service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:26.266197 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1194/2346] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:26.553093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acbdeb-50cd-423e-9f85-ea7995972a08 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:26.554684 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a4acbdeb-50cd-423e-9f85-ea7995972a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:26.571343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acbdeb-50cd-423e-9f85-ea7995972a08 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:26.577613 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:26.578356 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:26.578536 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:26.578842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] PATH_INFO: `/v3/projects/48e8489c58ce47719a623bd9974dca94` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:26.580142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e8489c58ce47719a623bd9974dca94)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:26.582038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:26.634869 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e8489c58ce47719a623bd9974dca94', 'request_id': 'req-df20f710-54b0-4a72-8179-d5a229ff1503'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.643731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e8489c58ce47719a623bd9974dca94', 'request_id': 'req-df20f710-54b0-4a72-8179-d5a229ff1503'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.655675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e8489c58ce47719a623bd9974dca94', 'request_id': 'req-df20f710-54b0-4a72-8179-d5a229ff1503'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.667795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] The token cache is being invalidate because project 48e8489c58ce47719a623bd9974dca94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:26.668080 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.668850 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:26.670491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1153/2347] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:26 2022] DELETE /identity/v3/projects/48e8489c58ce47719a623bd9974dca94 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:28.611586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656e583-b4c7-4d11-a34c-a0538732832d service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:28.613257 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4656e583-b4c7-4d11-a34c-a0538732832d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:28.702948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656e583-b4c7-4d11-a34c-a0538732832d service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:28.775638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55aab2-ecf0-4173-9d50-932e19e55b98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:28.776648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55aab2-ecf0-4173-9d50-932e19e55b98 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:28.776648 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55aab2-ecf0-4173-9d50-932e19e55b98 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:28.776940 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55aab2-ecf0-4173-9d50-932e19e55b98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:28.778684 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ae55aab2-ecf0-4173-9d50-932e19e55b98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:28.794865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55aab2-ecf0-4173-9d50-932e19e55b98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:28.796468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55aab2-ecf0-4173-9d50-932e19e55b98 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:28.809460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1195/2348] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:35.200915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:35.202547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:35.217703 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:35.268448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f710-54b0-4a72-8179-d5a229ff1503 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:35.272986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:35.273625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:35.273908 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:35.274181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] PATH_INFO: `/v3/users/52a15b8a08f549e18e8884fefaccbb7c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:35.275316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a15b8a08f549e18e8884fefaccbb7c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:35.277230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:35.330332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a15b8a08f549e18e8884fefaccbb7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.337733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a15b8a08f549e18e8884fefaccbb7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.351038 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a15b8a08f549e18e8884fefaccbb7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.359184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a15b8a08f549e18e8884fefaccbb7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.359814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a15b8a08f549e18e8884fefaccbb7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.366391 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1154/2349] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:35 2022] DELETE /identity/v3/users/52a15b8a08f549e18e8884fefaccbb7c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:35.371260 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911dfd-4a10-475f-bde1-e3ed462dd861 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:35.371771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911dfd-4a10-475f-bde1-e3ed462dd861 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:35.371972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911dfd-4a10-475f-bde1-e3ed462dd861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:35.391811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3f911dfd-4a10-475f-bde1-e3ed462dd861 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:35.393101 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3f911dfd-4a10-475f-bde1-e3ed462dd861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:35.432497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:35.455533 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1196/2350] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:35.465128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:35.466883 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:35.525991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7448b-bf30-42e2-8f59-19f4f6c0e5ee admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:35.529625 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbf025-88ec-4518-b098-c34706310ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:35.530243 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbf025-88ec-4518-b098-c34706310ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:35.530520 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbf025-88ec-4518-b098-c34706310ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:35.530821 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbf025-88ec-4518-b098-c34706310ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:35.539926 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbf025-88ec-4518-b098-c34706310ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:35.541343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbf025-88ec-4518-b098-c34706310ad1 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:35.550841 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1155/2351] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:35.832901 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f911dfd-4a10-475f-bde1-e3ed462dd861 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:35.834659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3f911dfd-4a10-475f-bde1-e3ed462dd861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:35.850065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f911dfd-4a10-475f-bde1-e3ed462dd861 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:35.856194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:35.856855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:35.857131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:35.857409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] PATH_INFO: `/v3/projects/6b15ba9a5f1545e09f3f606a881c1cf0` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:35.858612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b15ba9a5f1545e09f3f606a881c1cf0)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:35.860562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:35.915280 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b15ba9a5f1545e09f3f606a881c1cf0', 'request_id': 'req-e1455f31-f39e-4514-a97c-0f4eb19bb19a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.920973 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b15ba9a5f1545e09f3f606a881c1cf0', 'request_id': 'req-e1455f31-f39e-4514-a97c-0f4eb19bb19a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.927561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b15ba9a5f1545e09f3f606a881c1cf0', 'request_id': 'req-e1455f31-f39e-4514-a97c-0f4eb19bb19a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.940746 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] The token cache is being invalidate because project 6b15ba9a5f1545e09f3f606a881c1cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:35.941038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.941775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:35.943309 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1197/2352] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:35 2022] DELETE /identity/v3/projects/6b15ba9a5f1545e09f3f606a881c1cf0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:30:35.947424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbf025-88ec-4518-b098-c34706310ad1 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:35.957425 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbf025-88ec-4518-b098-c34706310ad1 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:35.989347 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:36.016807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:36.017452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.017725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.018024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] PATH_INFO: `/v3/users/85f2e38b97124256b6a2c8d57c513f54` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.019209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f2e38b97124256b6a2c8d57c513f54)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:36.021126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:36.066549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f2e38b97124256b6a2c8d57c513f54'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.073478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f2e38b97124256b6a2c8d57c513f54'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.085810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f2e38b97124256b6a2c8d57c513f54'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.093183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f2e38b97124256b6a2c8d57c513f54'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.093899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-488331ca-b96b-47e9-8072-eea7cc91b71d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f2e38b97124256b6a2c8d57c513f54'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.100108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1156/2353] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:35 2022] DELETE /identity/v3/users/85f2e38b97124256b6a2c8d57c513f54 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:30:36.373096 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:36.374609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:36.387604 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1455f31-f39e-4514-a97c-0f4eb19bb19a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:36.447175 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:36.447819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.448100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.448370 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] PATH_INFO: `/v3/projects/c11901841336496795a5892b3eab5c48` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.449524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11901841336496795a5892b3eab5c48)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:36.451441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:36.506079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11901841336496795a5892b3eab5c48', 'request_id': 'req-84972004-50c3-492f-9cb9-ec1f7cc037dc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.511904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11901841336496795a5892b3eab5c48', 'request_id': 'req-84972004-50c3-492f-9cb9-ec1f7cc037dc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.518543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11901841336496795a5892b3eab5c48', 'request_id': 'req-84972004-50c3-492f-9cb9-ec1f7cc037dc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.522323 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:36.535307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] The token cache is being invalidate because project c11901841336496795a5892b3eab5c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:36.535614 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.536229 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-84972004-50c3-492f-9cb9-ec1f7cc037dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:36.537833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1198/2354] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:36 2022] DELETE /identity/v3/projects/c11901841336496795a5892b3eab5c48 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:36.542775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc370690-2e36-4756-bb8b-cbef44d65a1f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.543256 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc370690-2e36-4756-bb8b-cbef44d65a1f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.543368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc370690-2e36-4756-bb8b-cbef44d65a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.563104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fc370690-2e36-4756-bb8b-cbef44d65a1f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:36.564302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fc370690-2e36-4756-bb8b-cbef44d65a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:36.633153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1157/2355] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:36.641350 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cda9f-2c04-4125-9138-0561c9ce3799 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.641644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cda9f-2c04-4125-9138-0561c9ce3799 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.641935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cda9f-2c04-4125-9138-0561c9ce3799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.663177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-940cda9f-2c04-4125-9138-0561c9ce3799 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:36.664428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-940cda9f-2c04-4125-9138-0561c9ce3799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:36.673373 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1199/2356] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:36.677878 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc370690-2e36-4756-bb8b-cbef44d65a1f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:36.689046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc370690-2e36-4756-bb8b-cbef44d65a1f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:36.695328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7dfb-343b-48c9-8101-97f0ffb89289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:36.695949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7dfb-343b-48c9-8101-97f0ffb89289 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.696227 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7dfb-343b-48c9-8101-97f0ffb89289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.696492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7dfb-343b-48c9-8101-97f0ffb89289 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.697140 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e7dfb-343b-48c9-8101-97f0ffb89289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:30:36.697440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e7dfb-343b-48c9-8101-97f0ffb89289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:36.699076 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e7dfb-343b-48c9-8101-97f0ffb89289 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:36.711170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1158/2357] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:30:36.715661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cda9f-2c04-4125-9138-0561c9ce3799 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:36.725468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cda9f-2c04-4125-9138-0561c9ce3799 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:36.731060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e557bb7-ea94-415b-9231-cb188057aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:36.731667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e557bb7-ea94-415b-9231-cb188057aea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.731946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e557bb7-ea94-415b-9231-cb188057aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.732303 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e557bb7-ea94-415b-9231-cb188057aea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.733172 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e557bb7-ea94-415b-9231-cb188057aea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:36.735181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e557bb7-ea94-415b-9231-cb188057aea1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:36.765971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1200/2358] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:36 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:36.770267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7dfb-343b-48c9-8101-97f0ffb89289 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:36.780405 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7dfb-343b-48c9-8101-97f0ffb89289 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:36.820547 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:36.843574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa2400-8aaa-4f3b-ab3c-cefce23dc140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:36.844773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa2400-8aaa-4f3b-ab3c-cefce23dc140 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.845301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa2400-8aaa-4f3b-ab3c-cefce23dc140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.845594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa2400-8aaa-4f3b-ab3c-cefce23dc140 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.846516 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa2400-8aaa-4f3b-ab3c-cefce23dc140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:36.848521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa2400-8aaa-4f3b-ab3c-cefce23dc140 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:36.871404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1159/2359] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:36 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:36.875863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e557bb7-ea94-415b-9231-cb188057aea1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:36.886781 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e557bb7-ea94-415b-9231-cb188057aea1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:36.892086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee8c24-e8b9-4f2f-9bce-8c36a160a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:36.892699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee8c24-e8b9-4f2f-9bce-8c36a160a9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.892979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee8c24-e8b9-4f2f-9bce-8c36a160a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.893252 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee8c24-e8b9-4f2f-9bce-8c36a160a9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.893906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee8c24-e8b9-4f2f-9bce-8c36a160a9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:36.895584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee8c24-e8b9-4f2f-9bce-8c36a160a9ba admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:36.906706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1201/2360] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:36.910833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa2400-8aaa-4f3b-ab3c-cefce23dc140 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:36.921524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa2400-8aaa-4f3b-ab3c-cefce23dc140 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:36.927322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26fb14-7437-4b53-a0a2-0a04241f5e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:36.927916 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26fb14-7437-4b53-a0a2-0a04241f5e27 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.928189 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26fb14-7437-4b53-a0a2-0a04241f5e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.928436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26fb14-7437-4b53-a0a2-0a04241f5e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.929083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26fb14-7437-4b53-a0a2-0a04241f5e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:36.930681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26fb14-7437-4b53-a0a2-0a04241f5e27 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:36.942111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1160/2361] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:36.946593 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee8c24-e8b9-4f2f-9bce-8c36a160a9ba admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:36.957660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee8c24-e8b9-4f2f-9bce-8c36a160a9ba admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:36.963659 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02784ef5-2435-42e2-8bf2-bca4dec11511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:36.964308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784ef5-2435-42e2-8bf2-bca4dec11511 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:36.964589 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784ef5-2435-42e2-8bf2-bca4dec11511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:36.964862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784ef5-2435-42e2-8bf2-bca4dec11511 admin admin] PATH_INFO: `/v3/projects/7d8bdd99531745a0922df2f9c3bdff48/users/1cf7956401fd4efab8db3dc45d78d7ce/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:36.981015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02784ef5-2435-42e2-8bf2-bca4dec11511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8bdd99531745a0922df2f9c3bdff48, user_id=1cf7956401fd4efab8db3dc45d78d7ce, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:36.983722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02784ef5-2435-42e2-8bf2-bca4dec11511 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:36.998038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1202/2362] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:36 2022] PUT /identity/v3/projects/7d8bdd99531745a0922df2f9c3bdff48/users/1cf7956401fd4efab8db3dc45d78d7ce/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:37.009635 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb52e39-02e3-42b3-b09c-b436218fadad None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:37.010014 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb52e39-02e3-42b3-b09c-b436218fadad None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:37.010322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb52e39-02e3-42b3-b09c-b436218fadad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:37.040728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-dcb52e39-02e3-42b3-b09c-b436218fadad None None] MFA Rules not processed for user `1cf7956401fd4efab8db3dc45d78d7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:37.041867 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dcb52e39-02e3-42b3-b09c-b436218fadad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:37.109875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1161/2363] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:37.114522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02784ef5-2435-42e2-8bf2-bca4dec11511 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:37.177948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02784ef5-2435-42e2-8bf2-bca4dec11511 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:37.184288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b40f9b-d2f1-4b7a-871a-4958f9807120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:37.184902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40f9b-d2f1-4b7a-871a-4958f9807120 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:37.185179 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40f9b-d2f1-4b7a-871a-4958f9807120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:37.185448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40f9b-d2f1-4b7a-871a-4958f9807120 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:37.186091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b40f9b-d2f1-4b7a-871a-4958f9807120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:37.188008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b40f9b-d2f1-4b7a-871a-4958f9807120 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:37.217557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1203/2364] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:37 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:37.221838 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb52e39-02e3-42b3-b09c-b436218fadad None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:37.234100 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb52e39-02e3-42b3-b09c-b436218fadad None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:37.295098 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118ae4b-0d3b-483a-9e14-86b33d697273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:37.295632 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118ae4b-0d3b-483a-9e14-86b33d697273 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:37.295913 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118ae4b-0d3b-483a-9e14-86b33d697273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:37.296183 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118ae4b-0d3b-483a-9e14-86b33d697273 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:37.296819 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118ae4b-0d3b-483a-9e14-86b33d697273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:37.298759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118ae4b-0d3b-483a-9e14-86b33d697273 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:37.322993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1162/2365] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:37 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:37.327182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b40f9b-d2f1-4b7a-871a-4958f9807120 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:37.338617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b40f9b-d2f1-4b7a-871a-4958f9807120 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:37.343697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb157-f0a2-49d1-b592-ffe6939f5f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:37.344312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb157-f0a2-49d1-b592-ffe6939f5f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:37.344595 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb157-f0a2-49d1-b592-ffe6939f5f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:37.344884 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb157-f0a2-49d1-b592-ffe6939f5f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:37.345512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcb157-f0a2-49d1-b592-ffe6939f5f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:37.347157 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcb157-f0a2-49d1-b592-ffe6939f5f3f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:37.358164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1204/2366] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:37.362515 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118ae4b-0d3b-483a-9e14-86b33d697273 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:37.373623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118ae4b-0d3b-483a-9e14-86b33d697273 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:37.378457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd97f7-f433-46b2-ad95-4b0d91f2af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:37.379159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd97f7-f433-46b2-ad95-4b0d91f2af2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:37.379445 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd97f7-f433-46b2-ad95-4b0d91f2af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:37.379719 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd97f7-f433-46b2-ad95-4b0d91f2af2f admin admin] PATH_INFO: `/v3/projects/ce42b38fe53f4f2982f32d63b1fa7728/users/ed5b436837f24fb9b283855cc23796d8/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:37.395360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd97f7-f433-46b2-ad95-4b0d91f2af2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce42b38fe53f4f2982f32d63b1fa7728, user_id=ed5b436837f24fb9b283855cc23796d8, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:37.398027 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd97f7-f433-46b2-ad95-4b0d91f2af2f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:37.412267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1163/2367] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:37 2022] PUT /identity/v3/projects/ce42b38fe53f4f2982f32d63b1fa7728/users/ed5b436837f24fb9b283855cc23796d8/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:37.416448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb157-f0a2-49d1-b592-ffe6939f5f3f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:37.428120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb157-f0a2-49d1-b592-ffe6939f5f3f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:37.486321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6780e5-ec70-47fa-bd47-ddd669838061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:37.487013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6780e5-ec70-47fa-bd47-ddd669838061 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:37.487289 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6780e5-ec70-47fa-bd47-ddd669838061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:37.487560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6780e5-ec70-47fa-bd47-ddd669838061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:37.488203 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6780e5-ec70-47fa-bd47-ddd669838061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:37.489795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6780e5-ec70-47fa-bd47-ddd669838061 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:37.500433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1205/2368] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:37.505222 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd97f7-f433-46b2-ad95-4b0d91f2af2f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:37.515374 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd97f7-f433-46b2-ad95-4b0d91f2af2f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:37.520022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd22875-359f-4bf9-9d1b-43134f85262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:37.520678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd22875-359f-4bf9-9d1b-43134f85262b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:37.520955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd22875-359f-4bf9-9d1b-43134f85262b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:37.521220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd22875-359f-4bf9-9d1b-43134f85262b admin admin] PATH_INFO: `/v3/projects/ce42b38fe53f4f2982f32d63b1fa7728/users/ed5b436837f24fb9b283855cc23796d8/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:37.523180 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd22875-359f-4bf9-9d1b-43134f85262b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce42b38fe53f4f2982f32d63b1fa7728, user_id=ed5b436837f24fb9b283855cc23796d8, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:37.525809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd22875-359f-4bf9-9d1b-43134f85262b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:37.536739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1164/2369] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:37 2022] PUT /identity/v3/projects/ce42b38fe53f4f2982f32d63b1fa7728/users/ed5b436837f24fb9b283855cc23796d8/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:37.547371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ff9a0-6f0a-4b8b-af5e-a6c78320ed01 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:37.547608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ff9a0-6f0a-4b8b-af5e-a6c78320ed01 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:37.547885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ff9a0-6f0a-4b8b-af5e-a6c78320ed01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:37.555454 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:37.577852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-608ff9a0-6f0a-4b8b-af5e-a6c78320ed01 None None] MFA Rules not processed for user `ed5b436837f24fb9b283855cc23796d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:37.579123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-608ff9a0-6f0a-4b8b-af5e-a6c78320ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:37.650541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1206/2370] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:37.661604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd22875-359f-4bf9-9d1b-43134f85262b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:37.663567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-afd22875-359f-4bf9-9d1b-43134f85262b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:37.669029 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:37.723024 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd22875-359f-4bf9-9d1b-43134f85262b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:37.727485 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523dbc5-6569-4ca1-94d7-ada1b215fbc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:37.728106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523dbc5-6569-4ca1-94d7-ada1b215fbc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:37.728377 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523dbc5-6569-4ca1-94d7-ada1b215fbc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:37.728671 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523dbc5-6569-4ca1-94d7-ada1b215fbc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:37.791623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523dbc5-6569-4ca1-94d7-ada1b215fbc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:37.793733 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523dbc5-6569-4ca1-94d7-ada1b215fbc6 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:37.808195 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1165/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:42.069931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ff9a0-6f0a-4b8b-af5e-a6c78320ed01 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:42.071615 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-608ff9a0-6f0a-4b8b-af5e-a6c78320ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:42.084804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ff9a0-6f0a-4b8b-af5e-a6c78320ed01 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:42.089028 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22895c-b205-4344-9adb-587836ce2a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:42.089633 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22895c-b205-4344-9adb-587836ce2a0b service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:42.089936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22895c-b205-4344-9adb-587836ce2a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:42.090180 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22895c-b205-4344-9adb-587836ce2a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:42.100103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22895c-b205-4344-9adb-587836ce2a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:42.101455 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22895c-b205-4344-9adb-587836ce2a0b service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:42.111312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1207/2372] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:47.061723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523dbc5-6569-4ca1-94d7-ada1b215fbc6 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:47.128701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523dbc5-6569-4ca1-94d7-ada1b215fbc6 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:47.133135 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:47.133759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:47.134035 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:47.134302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] PATH_INFO: `/v3/users/1cf7956401fd4efab8db3dc45d78d7ce` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:47.135455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf7956401fd4efab8db3dc45d78d7ce)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:47.137364 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:47.185481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf7956401fd4efab8db3dc45d78d7ce'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.192980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf7956401fd4efab8db3dc45d78d7ce'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.195026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:47.206318 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf7956401fd4efab8db3dc45d78d7ce'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.213535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf7956401fd4efab8db3dc45d78d7ce'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.214252 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf7956401fd4efab8db3dc45d78d7ce'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.220128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1166/2373] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:47 2022] DELETE /identity/v3/users/1cf7956401fd4efab8db3dc45d78d7ce => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:47.224855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33885dd-8ca3-423d-b9ad-a613e8a75b9b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:47.225369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33885dd-8ca3-423d-b9ad-a613e8a75b9b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:47.225484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33885dd-8ca3-423d-b9ad-a613e8a75b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:47.245934 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b33885dd-8ca3-423d-b9ad-a613e8a75b9b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:47.247193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b33885dd-8ca3-423d-b9ad-a613e8a75b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:47.308772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1208/2374] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:47.318906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:47.320615 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:47.381648 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd6c5a-ce65-497b-8ea0-72e8ec7eb4b5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:47.385986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a2854-9fb3-4c54-bfbb-d42b6093987e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:47.386590 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a2854-9fb3-4c54-bfbb-d42b6093987e service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:47.386900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a2854-9fb3-4c54-bfbb-d42b6093987e service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:47.387170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a2854-9fb3-4c54-bfbb-d42b6093987e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:47.396791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a2854-9fb3-4c54-bfbb-d42b6093987e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:47.398207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a2854-9fb3-4c54-bfbb-d42b6093987e service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:47.407932 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1167/2375] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:47.686937 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33885dd-8ca3-423d-b9ad-a613e8a75b9b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:47.688422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b33885dd-8ca3-423d-b9ad-a613e8a75b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:47.702226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33885dd-8ca3-423d-b9ad-a613e8a75b9b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:47.708125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:47.709050 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:47.709338 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:47.709607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] PATH_INFO: `/v3/projects/7d8bdd99531745a0922df2f9c3bdff48` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:47.710803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8bdd99531745a0922df2f9c3bdff48)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:47.712727 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:47.762227 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8bdd99531745a0922df2f9c3bdff48', 'request_id': 'req-43a59b1d-6484-4469-ba05-895ec3b358d2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.768104 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8bdd99531745a0922df2f9c3bdff48', 'request_id': 'req-43a59b1d-6484-4469-ba05-895ec3b358d2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.774543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8bdd99531745a0922df2f9c3bdff48', 'request_id': 'req-43a59b1d-6484-4469-ba05-895ec3b358d2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.784062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:47.790074 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] The token cache is being invalidate because project 7d8bdd99531745a0922df2f9c3bdff48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:47.790479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.791422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.793488 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1209/2376] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:47 2022] DELETE /identity/v3/projects/7d8bdd99531745a0922df2f9c3bdff48 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:47.799739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a2854-9fb3-4c54-bfbb-d42b6093987e service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:47.810581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a2854-9fb3-4c54-bfbb-d42b6093987e service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:47.872668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:47.873310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:47.873575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:47.873854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] PATH_INFO: `/v3/users/ed5b436837f24fb9b283855cc23796d8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:47.875107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5b436837f24fb9b283855cc23796d8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:47.877065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:47.925747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5b436837f24fb9b283855cc23796d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.932600 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5b436837f24fb9b283855cc23796d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.946246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5b436837f24fb9b283855cc23796d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.955304 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5b436837f24fb9b283855cc23796d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.955980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5f8b45d4-00db-423a-8b53-201b391f243a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5b436837f24fb9b283855cc23796d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:47.957538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:47.963715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1168/2377] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:30:47 2022] DELETE /identity/v3/users/ed5b436837f24fb9b283855cc23796d8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:48.237195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:48.238853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:48.252932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59b1d-6484-4469-ba05-895ec3b358d2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:48.312793 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:48.313442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.313718 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.313990 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] PATH_INFO: `/v3/projects/ce42b38fe53f4f2982f32d63b1fa7728` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.315160 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce42b38fe53f4f2982f32d63b1fa7728)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:48.317100 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:48.363853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce42b38fe53f4f2982f32d63b1fa7728', 'request_id': 'req-dbca663e-f53a-4f08-b639-31a30615820f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:48.370634 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce42b38fe53f4f2982f32d63b1fa7728', 'request_id': 'req-dbca663e-f53a-4f08-b639-31a30615820f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:48.379528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce42b38fe53f4f2982f32d63b1fa7728', 'request_id': 'req-dbca663e-f53a-4f08-b639-31a30615820f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:48.395700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] The token cache is being invalidate because project ce42b38fe53f4f2982f32d63b1fa7728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:30:48.396062 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:48.397013 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dbca663e-f53a-4f08-b639-31a30615820f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:30:48.399265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1210/2378] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:30:48 2022] DELETE /identity/v3/projects/ce42b38fe53f4f2982f32d63b1fa7728 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:48.405572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f54b-62f8-49da-8e5c-f508aff7e5da None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.406096 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f54b-62f8-49da-8e5c-f508aff7e5da None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.406208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f54b-62f8-49da-8e5c-f508aff7e5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.427254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8017f54b-62f8-49da-8e5c-f508aff7e5da None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:48.428460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8017f54b-62f8-49da-8e5c-f508aff7e5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:48.489392 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1169/2379] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:48.499122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da59ca-76cf-4d86-864f-0c879f0efd68 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.499491 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da59ca-76cf-4d86-864f-0c879f0efd68 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.499836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da59ca-76cf-4d86-864f-0c879f0efd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.525255 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-64da59ca-76cf-4d86-864f-0c879f0efd68 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:48.526484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-64da59ca-76cf-4d86-864f-0c879f0efd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:48.535815 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1211/2380] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:48.540824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f54b-62f8-49da-8e5c-f508aff7e5da None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:48.553888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f54b-62f8-49da-8e5c-f508aff7e5da None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:48.559618 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06612c-d8ab-45e7-9ac2-3eb208d45fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:48.560219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06612c-d8ab-45e7-9ac2-3eb208d45fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.560493 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06612c-d8ab-45e7-9ac2-3eb208d45fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.560769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06612c-d8ab-45e7-9ac2-3eb208d45fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.561403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06612c-d8ab-45e7-9ac2-3eb208d45fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:30:48.561713 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06612c-d8ab-45e7-9ac2-3eb208d45fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:48.563353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06612c-d8ab-45e7-9ac2-3eb208d45fb7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:48.575197 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1170/2381] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:30:48.579511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da59ca-76cf-4d86-864f-0c879f0efd68 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:48.589117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da59ca-76cf-4d86-864f-0c879f0efd68 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:48.594864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2b476-ffdb-49f1-b480-b598abce2c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:48.595661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2b476-ffdb-49f1-b480-b598abce2c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.596053 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2b476-ffdb-49f1-b480-b598abce2c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.596226 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2b476-ffdb-49f1-b480-b598abce2c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.596982 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2b476-ffdb-49f1-b480-b598abce2c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:48.599166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2b476-ffdb-49f1-b480-b598abce2c03 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:48.629528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1212/2382] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:30:48 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:48.633864 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06612c-d8ab-45e7-9ac2-3eb208d45fb7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:48.644382 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06612c-d8ab-45e7-9ac2-3eb208d45fb7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:48.702620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c1e3a-e590-4cec-a8e3-1ccfaaaf9b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:48.703251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c1e3a-e590-4cec-a8e3-1ccfaaaf9b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.703526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c1e3a-e590-4cec-a8e3-1ccfaaaf9b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.703790 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c1e3a-e590-4cec-a8e3-1ccfaaaf9b5f admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.704411 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c1e3a-e590-4cec-a8e3-1ccfaaaf9b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:48.706355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c1e3a-e590-4cec-a8e3-1ccfaaaf9b5f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:48.729209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1171/2383] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:30:48 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:30:48.733538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2b476-ffdb-49f1-b480-b598abce2c03 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:48.744348 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2b476-ffdb-49f1-b480-b598abce2c03 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:48.748989 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1a1ee-4437-4984-af84-2f66eb09f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:48.749588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1a1ee-4437-4984-af84-2f66eb09f296 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.749863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1a1ee-4437-4984-af84-2f66eb09f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.750129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1a1ee-4437-4984-af84-2f66eb09f296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.750805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1a1ee-4437-4984-af84-2f66eb09f296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:48.752376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1a1ee-4437-4984-af84-2f66eb09f296 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:48.762224 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1213/2384] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:48.766045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c1e3a-e590-4cec-a8e3-1ccfaaaf9b5f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:48.776162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c1e3a-e590-4cec-a8e3-1ccfaaaf9b5f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:48.781401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68d912-e1a5-4fa8-b908-ca8e97eebf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:48.781995 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68d912-e1a5-4fa8-b908-ca8e97eebf01 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.782269 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68d912-e1a5-4fa8-b908-ca8e97eebf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.782537 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68d912-e1a5-4fa8-b908-ca8e97eebf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.783212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68d912-e1a5-4fa8-b908-ca8e97eebf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:48.784786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68d912-e1a5-4fa8-b908-ca8e97eebf01 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:48.795324 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1172/2385] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:30:48.799867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1a1ee-4437-4984-af84-2f66eb09f296 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:48.810535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1a1ee-4437-4984-af84-2f66eb09f296 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:48.816597 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed4ae-09ea-4286-b2f2-256b35e27845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:48.817275 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed4ae-09ea-4286-b2f2-256b35e27845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.817556 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed4ae-09ea-4286-b2f2-256b35e27845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.817898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed4ae-09ea-4286-b2f2-256b35e27845 admin admin] PATH_INFO: `/v3/projects/3016653c4f384696bab383ae22c692c4/users/f875a010159842a08f65bd9bf4679d94/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.836722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ed4ae-09ea-4286-b2f2-256b35e27845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3016653c4f384696bab383ae22c692c4, user_id=f875a010159842a08f65bd9bf4679d94, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:48.839708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ed4ae-09ea-4286-b2f2-256b35e27845 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:48.858427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1214/2386] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:30:48 2022] PUT /identity/v3/projects/3016653c4f384696bab383ae22c692c4/users/f875a010159842a08f65bd9bf4679d94/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:48.865974 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099201e7-b2a5-4156-8902-694b88c2cbe8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.866337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099201e7-b2a5-4156-8902-694b88c2cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.866764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099201e7-b2a5-4156-8902-694b88c2cbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.890870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-099201e7-b2a5-4156-8902-694b88c2cbe8 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:48.892088 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-099201e7-b2a5-4156-8902-694b88c2cbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:48.965187 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1173/2387] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:48.975483 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed4ae-09ea-4286-b2f2-256b35e27845 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:48.977356 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4f1ed4ae-09ea-4286-b2f2-256b35e27845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:49.006662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:49.038415 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed4ae-09ea-4286-b2f2-256b35e27845 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:49.042137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a014550-135c-444d-85d8-d1bc48062921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:49.042744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a014550-135c-444d-85d8-d1bc48062921 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:49.043055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a014550-135c-444d-85d8-d1bc48062921 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:49.043325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a014550-135c-444d-85d8-d1bc48062921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:49.053529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a014550-135c-444d-85d8-d1bc48062921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:49.054992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a014550-135c-444d-85d8-d1bc48062921 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:49.064812 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1215/2388] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:30:49.735567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa294bf-2f2c-42a7-a88b-9dec08259e5d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:49.736173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa294bf-2f2c-42a7-a88b-9dec08259e5d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:49.736173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa294bf-2f2c-42a7-a88b-9dec08259e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:49.744870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:49.766579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-eaa294bf-2f2c-42a7-a88b-9dec08259e5d None None] MFA Rules not processed for user `f875a010159842a08f65bd9bf4679d94`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:49.767616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eaa294bf-2f2c-42a7-a88b-9dec08259e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:49.840255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1174/2389] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:49.851661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a014550-135c-444d-85d8-d1bc48062921 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:49.853139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5a014550-135c-444d-85d8-d1bc48062921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:49.910930 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a014550-135c-444d-85d8-d1bc48062921 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:49.916600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d4b98-188a-4f1f-b659-76d1f123769c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:49.917368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d4b98-188a-4f1f-b659-76d1f123769c service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:49.917715 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d4b98-188a-4f1f-b659-76d1f123769c service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:49.918122 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d4b98-188a-4f1f-b659-76d1f123769c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:49.932318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d4b98-188a-4f1f-b659-76d1f123769c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:49.934575 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d4b98-188a-4f1f-b659-76d1f123769c service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:49.946598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1216/2390] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:30:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:51.328944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409421f3-cf48-4111-b7f5-c3d9f357432a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:51.329484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409421f3-cf48-4111-b7f5-c3d9f357432a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:51.329484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409421f3-cf48-4111-b7f5-c3d9f357432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:51.349176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-409421f3-cf48-4111-b7f5-c3d9f357432a None None] MFA Rules not processed for user `f875a010159842a08f65bd9bf4679d94`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:51.350372 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-409421f3-cf48-4111-b7f5-c3d9f357432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:51.357773 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1175/2391] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:30:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:59.942559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=41 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:01.343481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=33 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:05.654030 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db465a-a67c-43ed-8bc3-956b6063ea9e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:05.654580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db465a-a67c-43ed-8bc3-956b6063ea9e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:05.654580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db465a-a67c-43ed-8bc3-956b6063ea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:05.674632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-63db465a-a67c-43ed-8bc3-956b6063ea9e None None] MFA Rules not processed for user `f875a010159842a08f65bd9bf4679d94`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:05.675865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-63db465a-a67c-43ed-8bc3-956b6063ea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:05.683935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1217/2392] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:15.668759 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:17.286468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca47b4-a759-47dd-8365-503c31361360 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:17.287036 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca47b4-a759-47dd-8365-503c31361360 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:17.287243 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca47b4-a759-47dd-8365-503c31361360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:17.306452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-33ca47b4-a759-47dd-8365-503c31361360 None None] MFA Rules not processed for user `cdaa7f35aa2a45d7acfc9a00d63a6d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:17.307682 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-33ca47b4-a759-47dd-8365-503c31361360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:17.363647 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1176/2393] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:23.027777 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8f37-e6b5-48c6-95ae-184b413dbd94 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:23.028236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8f37-e6b5-48c6-95ae-184b413dbd94 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:23.028345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8f37-e6b5-48c6-95ae-184b413dbd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:23.048762 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-35aa8f37-e6b5-48c6-95ae-184b413dbd94 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:23.049975 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-35aa8f37-e6b5-48c6-95ae-184b413dbd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:23.109136 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1218/2394] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:23.163363 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca47b4-a759-47dd-8365-503c31361360 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:23.165668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-33ca47b4-a759-47dd-8365-503c31361360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:23.240630 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca47b4-a759-47dd-8365-503c31361360 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:23.246047 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a5d0f-eb02-4729-a932-62dac3205092 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:23.246767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a5d0f-eb02-4729-a932-62dac3205092 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:23.247152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a5d0f-eb02-4729-a932-62dac3205092 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:23.247499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a5d0f-eb02-4729-a932-62dac3205092 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:23.256284 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a5d0f-eb02-4729-a932-62dac3205092 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:23.257857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a5d0f-eb02-4729-a932-62dac3205092 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:23.266261 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1177/2395] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:31:33.101344 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=25 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:33.263202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=57 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:37.742070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954fad-deda-4917-aa92-c86e03bb5331 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:37.742626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954fad-deda-4917-aa92-c86e03bb5331 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:37.742626 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954fad-deda-4917-aa92-c86e03bb5331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:37.762080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fb954fad-deda-4917-aa92-c86e03bb5331 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:37.763299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fb954fad-deda-4917-aa92-c86e03bb5331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:37.770697 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1219/2396] 10.222.0.23 () {58 vars in 967 bytes} [Thu Oct 27 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:37.783165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a5d0f-eb02-4729-a932-62dac3205092 service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:37.795016 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a5d0f-eb02-4729-a932-62dac3205092 service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:37.800857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac8557-9e9e-4eaa-85dc-274411715f4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:37.801491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac8557-9e9e-4eaa-85dc-274411715f4f service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:37.801771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac8557-9e9e-4eaa-85dc-274411715f4f service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:37.802045 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac8557-9e9e-4eaa-85dc-274411715f4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:37.810797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac8557-9e9e-4eaa-85dc-274411715f4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:37.812376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac8557-9e9e-4eaa-85dc-274411715f4f service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:37.820489 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1178/2397] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:31:39.972612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb954fad-deda-4917-aa92-c86e03bb5331 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:39.974215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fb954fad-deda-4917-aa92-c86e03bb5331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:40.025849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac8557-9e9e-4eaa-85dc-274411715f4f service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:40.047993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac8557-9e9e-4eaa-85dc-274411715f4f service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:40.052535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:40.052909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb954fad-deda-4917-aa92-c86e03bb5331 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:40.053172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.053454 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.053729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] PATH_INFO: `/v3/users/f875a010159842a08f65bd9bf4679d94` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.055120 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f875a010159842a08f65bd9bf4679d94)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:40.057039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:40.058120 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a63e1-c511-4e98-9161-ed8167957063 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:40.059009 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a63e1-c511-4e98-9161-ed8167957063 service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.059666 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a63e1-c511-4e98-9161-ed8167957063 service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.059958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a63e1-c511-4e98-9161-ed8167957063 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.061776 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d18a63e1-c511-4e98-9161-ed8167957063 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:40.073573 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a63e1-c511-4e98-9161-ed8167957063 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:40.075719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a63e1-c511-4e98-9161-ed8167957063 service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:40.086351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1220/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:31:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:31:40.109499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f875a010159842a08f65bd9bf4679d94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.117421 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f875a010159842a08f65bd9bf4679d94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.130225 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f875a010159842a08f65bd9bf4679d94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.138960 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f875a010159842a08f65bd9bf4679d94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.139560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9956d498-98cf-4d86-b7ba-41f1f2c503ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f875a010159842a08f65bd9bf4679d94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.145410 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1179/2399] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:31:40 2022] DELETE /identity/v3/users/f875a010159842a08f65bd9bf4679d94 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:31:40.320919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a63e1-c511-4e98-9161-ed8167957063 service placement] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:40.331761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a63e1-c511-4e98-9161-ed8167957063 service placement] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:40.390980 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:40.391629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.391905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.392173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] PATH_INFO: `/v3/projects/3016653c4f384696bab383ae22c692c4` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.393456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3016653c4f384696bab383ae22c692c4)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:40.395416 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:40.446409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3016653c4f384696bab383ae22c692c4', 'request_id': 'req-07c5e763-7afb-4e0d-9336-3e0f70149454'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.452819 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3016653c4f384696bab383ae22c692c4', 'request_id': 'req-07c5e763-7afb-4e0d-9336-3e0f70149454'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.459409 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3016653c4f384696bab383ae22c692c4', 'request_id': 'req-07c5e763-7afb-4e0d-9336-3e0f70149454'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.473971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] The token cache is being invalidate because project 3016653c4f384696bab383ae22c692c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:31:40.474287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.474953 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-07c5e763-7afb-4e0d-9336-3e0f70149454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:31:40.476526 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1221/2400] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:31:40 2022] DELETE /identity/v3/projects/3016653c4f384696bab383ae22c692c4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:31:40.481603 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b4bad-b14e-4905-a03f-d55948b12075 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.481990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b4bad-b14e-4905-a03f-d55948b12075 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.482266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b4bad-b14e-4905-a03f-d55948b12075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.502264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5c1b4bad-b14e-4905-a03f-d55948b12075 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:40.503559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5c1b4bad-b14e-4905-a03f-d55948b12075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:40.564136 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1180/2401] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:40.571871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87137ba1-ba20-4655-9888-317739314e9a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.572154 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87137ba1-ba20-4655-9888-317739314e9a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.572426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87137ba1-ba20-4655-9888-317739314e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.593307 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-87137ba1-ba20-4655-9888-317739314e9a None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:40.594506 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-87137ba1-ba20-4655-9888-317739314e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:40.603308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1222/2402] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:40.607702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b4bad-b14e-4905-a03f-d55948b12075 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:40.618187 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b4bad-b14e-4905-a03f-d55948b12075 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:40.623836 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff7ce-a576-41f3-854b-43edda31eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:40.624435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff7ce-a576-41f3-854b-43edda31eafa admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.624715 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff7ce-a576-41f3-854b-43edda31eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.624988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff7ce-a576-41f3-854b-43edda31eafa admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.625639 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aff7ce-a576-41f3-854b-43edda31eafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:31:40.625945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aff7ce-a576-41f3-854b-43edda31eafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:40.627589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aff7ce-a576-41f3-854b-43edda31eafa admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:40.639210 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1181/2403] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:31:40.643420 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87137ba1-ba20-4655-9888-317739314e9a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:40.652672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87137ba1-ba20-4655-9888-317739314e9a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:40.658103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293616d-ed8d-403b-9c36-92b1608bd962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:40.658698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293616d-ed8d-403b-9c36-92b1608bd962 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.659031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293616d-ed8d-403b-9c36-92b1608bd962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.659270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293616d-ed8d-403b-9c36-92b1608bd962 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.659897 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293616d-ed8d-403b-9c36-92b1608bd962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:40.661778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293616d-ed8d-403b-9c36-92b1608bd962 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:40.666635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:40.698150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1223/2404] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:31:40 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:31:40.703165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff7ce-a576-41f3-854b-43edda31eafa admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:40.717895 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff7ce-a576-41f3-854b-43edda31eafa admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:40.765305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:40.780448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d962603-7622-43a2-8c55-ca6e5f54a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:40.781097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d962603-7622-43a2-8c55-ca6e5f54a956 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.781379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d962603-7622-43a2-8c55-ca6e5f54a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.781673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d962603-7622-43a2-8c55-ca6e5f54a956 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.782301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d962603-7622-43a2-8c55-ca6e5f54a956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:40.784266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d962603-7622-43a2-8c55-ca6e5f54a956 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:40.806963 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1182/2405] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:31:40 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:31:40.811330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293616d-ed8d-403b-9c36-92b1608bd962 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:40.821969 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293616d-ed8d-403b-9c36-92b1608bd962 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:40.827377 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6765373-1e35-4ac3-b9d2-dfa684831142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:40.827998 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6765373-1e35-4ac3-b9d2-dfa684831142 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.828277 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6765373-1e35-4ac3-b9d2-dfa684831142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.828550 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6765373-1e35-4ac3-b9d2-dfa684831142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.829248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6765373-1e35-4ac3-b9d2-dfa684831142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:40.830906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6765373-1e35-4ac3-b9d2-dfa684831142 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:40.841846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1224/2406] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:31:40.846789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d962603-7622-43a2-8c55-ca6e5f54a956 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:40.861568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d962603-7622-43a2-8c55-ca6e5f54a956 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:40.868343 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52162609-572a-47c3-bfaf-1b69766b30fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:40.868948 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52162609-572a-47c3-bfaf-1b69766b30fd admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.869234 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52162609-572a-47c3-bfaf-1b69766b30fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.869508 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52162609-572a-47c3-bfaf-1b69766b30fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.870154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52162609-572a-47c3-bfaf-1b69766b30fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:40.871832 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52162609-572a-47c3-bfaf-1b69766b30fd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:40.883228 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1183/2407] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:31:40.887492 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6765373-1e35-4ac3-b9d2-dfa684831142 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:40.897660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6765373-1e35-4ac3-b9d2-dfa684831142 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:40.902571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5127391-5764-4ab8-a16e-5e2c406b7356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:40.903250 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5127391-5764-4ab8-a16e-5e2c406b7356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.903523 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5127391-5764-4ab8-a16e-5e2c406b7356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.903792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5127391-5764-4ab8-a16e-5e2c406b7356 admin admin] PATH_INFO: `/v3/projects/925c3f76d23844218547d771b3b772cc/users/9208660dd7504213a1eee4e72abad956/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.918741 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5127391-5764-4ab8-a16e-5e2c406b7356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925c3f76d23844218547d771b3b772cc, user_id=9208660dd7504213a1eee4e72abad956, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:40.921403 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5127391-5764-4ab8-a16e-5e2c406b7356 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:40.937700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1225/2408] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:31:40 2022] PUT /identity/v3/projects/925c3f76d23844218547d771b3b772cc/users/9208660dd7504213a1eee4e72abad956/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:31:40.943275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ebac2-845f-4ce1-9a09-218293b87ddb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:40.943568 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ebac2-845f-4ce1-9a09-218293b87ddb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:40.943842 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ebac2-845f-4ce1-9a09-218293b87ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:40.963747 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cc6ebac2-845f-4ce1-9a09-218293b87ddb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:40.964953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cc6ebac2-845f-4ce1-9a09-218293b87ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:41.030066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1184/2409] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:41.040555 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5127391-5764-4ab8-a16e-5e2c406b7356 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:41.043235 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a5127391-5764-4ab8-a16e-5e2c406b7356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:41.102652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5127391-5764-4ab8-a16e-5e2c406b7356 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:41.107193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c0cc-00ae-4b31-8393-782dfa2b3a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:41.107802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c0cc-00ae-4b31-8393-782dfa2b3a1b service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:41.108083 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c0cc-00ae-4b31-8393-782dfa2b3a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:41.108351 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c0cc-00ae-4b31-8393-782dfa2b3a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:41.118294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6c0cc-00ae-4b31-8393-782dfa2b3a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:41.119734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6c0cc-00ae-4b31-8393-782dfa2b3a1b service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:41.129245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1226/2410] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:31:41.732186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8147ee-8ae2-47b4-8284-ba98191811eb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:41.732559 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8147ee-8ae2-47b4-8284-ba98191811eb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:41.732958 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8147ee-8ae2-47b4-8284-ba98191811eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:41.762409 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-fc8147ee-8ae2-47b4-8284-ba98191811eb None None] MFA Rules not processed for user `9208660dd7504213a1eee4e72abad956`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:41.763698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fc8147ee-8ae2-47b4-8284-ba98191811eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:41.839791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1185/2411] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:41.851559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c0cc-00ae-4b31-8393-782dfa2b3a1b service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:41.852960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-04d6c0cc-00ae-4b31-8393-782dfa2b3a1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:41.914520 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c0cc-00ae-4b31-8393-782dfa2b3a1b service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:41.918354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03407cf0-1f56-4c45-b90c-ace6eee44ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:41.918991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03407cf0-1f56-4c45-b90c-ace6eee44ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:41.919308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03407cf0-1f56-4c45-b90c-ace6eee44ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:41.919591 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03407cf0-1f56-4c45-b90c-ace6eee44ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:41.928545 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03407cf0-1f56-4c45-b90c-ace6eee44ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:41.929999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03407cf0-1f56-4c45-b90c-ace6eee44ae1 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:41.938903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1227/2412] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:31:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:31:43.320101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ffa8-281c-48f5-bde9-11fc837620db None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:43.320646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ffa8-281c-48f5-bde9-11fc837620db None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:43.320646 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ffa8-281c-48f5-bde9-11fc837620db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:43.344385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0d30ffa8-281c-48f5-bde9-11fc837620db None None] MFA Rules not processed for user `9208660dd7504213a1eee4e72abad956`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:43.345644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0d30ffa8-281c-48f5-bde9-11fc837620db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:43.353579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1186/2413] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:51.935079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=73,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:53.338513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:10.648720 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b43457-9c43-4171-ab0a-037ad87f68bb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:10.649389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b43457-9c43-4171-ab0a-037ad87f68bb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:10.649389 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b43457-9c43-4171-ab0a-037ad87f68bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:10.729698 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f8b43457-9c43-4171-ab0a-037ad87f68bb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:10.730944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f8b43457-9c43-4171-ab0a-037ad87f68bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:10.782055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1228/2414] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:10.818226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30ffa8-281c-48f5-bde9-11fc837620db None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:10.819796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0d30ffa8-281c-48f5-bde9-11fc837620db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:10.986802 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30ffa8-281c-48f5-bde9-11fc837620db None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:10.993957 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb87a7-92ec-439f-b604-87d7cf03488f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:10.994577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb87a7-92ec-439f-b604-87d7cf03488f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:10.994875 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb87a7-92ec-439f-b604-87d7cf03488f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:10.995146 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb87a7-92ec-439f-b604-87d7cf03488f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:11.003340 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb87a7-92ec-439f-b604-87d7cf03488f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:11.004951 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb87a7-92ec-439f-b604-87d7cf03488f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:11.014145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1187/2415] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:14.755386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e633302-ddf1-45fa-b4ed-d1bb7509e562 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:14.755976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e633302-ddf1-45fa-b4ed-d1bb7509e562 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:14.755976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e633302-ddf1-45fa-b4ed-d1bb7509e562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:14.778214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2e633302-ddf1-45fa-b4ed-d1bb7509e562 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:14.779458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2e633302-ddf1-45fa-b4ed-d1bb7509e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:14.788785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1229/2416] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:14.820033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb87a7-92ec-439f-b604-87d7cf03488f service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:14.821696 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-89bb87a7-92ec-439f-b604-87d7cf03488f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:14.837909 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb87a7-92ec-439f-b604-87d7cf03488f service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:14.843965 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff961b-6168-4995-b161-91ecafc3b3f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:14.844569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff961b-6168-4995-b161-91ecafc3b3f4 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:14.844866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff961b-6168-4995-b161-91ecafc3b3f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:14.845540 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff961b-6168-4995-b161-91ecafc3b3f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:14.853941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff961b-6168-4995-b161-91ecafc3b3f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:14.855542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff961b-6168-4995-b161-91ecafc3b3f4 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:14.865594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1188/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:18.022318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15817ff6-f281-467c-8b2e-7b1fc69859eb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:18.022914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15817ff6-f281-467c-8b2e-7b1fc69859eb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:18.022914 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15817ff6-f281-467c-8b2e-7b1fc69859eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:18.043586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-15817ff6-f281-467c-8b2e-7b1fc69859eb None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:18.044777 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-15817ff6-f281-467c-8b2e-7b1fc69859eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:18.053518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1230/2418] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:18.076144 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff961b-6168-4995-b161-91ecafc3b3f4 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:18.088263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff961b-6168-4995-b161-91ecafc3b3f4 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:18.094237 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9bd48-9b35-47db-bc18-d225bff142c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:18.094883 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9bd48-9b35-47db-bc18-d225bff142c3 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:18.095161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9bd48-9b35-47db-bc18-d225bff142c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:18.095432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9bd48-9b35-47db-bc18-d225bff142c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:18.104079 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9bd48-9b35-47db-bc18-d225bff142c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:18.105707 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9bd48-9b35-47db-bc18-d225bff142c3 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:18.116337 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1189/2419] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:21.120577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bca7f8-1ca0-40d7-8bf5-1ea7c3c3d666 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:21.121166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bca7f8-1ca0-40d7-8bf5-1ea7c3c3d666 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:21.121166 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bca7f8-1ca0-40d7-8bf5-1ea7c3c3d666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:21.132412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9bd48-9b35-47db-bc18-d225bff142c3 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:21.134949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-83d9bd48-9b35-47db-bc18-d225bff142c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:21.146494 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-72bca7f8-1ca0-40d7-8bf5-1ea7c3c3d666 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:21.148079 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-72bca7f8-1ca0-40d7-8bf5-1ea7c3c3d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:21.157457 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1231/2420] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:21.185892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bca7f8-1ca0-40d7-8bf5-1ea7c3c3d666 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:21.198532 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:21.201346 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bca7f8-1ca0-40d7-8bf5-1ea7c3c3d666 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:21.207478 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2fdf7-5c44-48af-af33-b2c2466b1e23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:21.208045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2fdf7-5c44-48af-af33-b2c2466b1e23 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:21.208326 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2fdf7-5c44-48af-af33-b2c2466b1e23 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:21.208609 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2fdf7-5c44-48af-af33-b2c2466b1e23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:21.218975 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2fdf7-5c44-48af-af33-b2c2466b1e23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:21.220545 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2fdf7-5c44-48af-af33-b2c2466b1e23 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:21.238203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9bd48-9b35-47db-bc18-d225bff142c3 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:21.240524 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1232/2421] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:21.243860 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63010c-d738-4eaa-9907-954d419a1416 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:21.244479 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63010c-d738-4eaa-9907-954d419a1416 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:21.244809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63010c-d738-4eaa-9907-954d419a1416 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:21.245083 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63010c-d738-4eaa-9907-954d419a1416 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:21.246846 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4e63010c-d738-4eaa-9907-954d419a1416 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:21.258627 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63010c-d738-4eaa-9907-954d419a1416 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:21.260240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63010c-d738-4eaa-9907-954d419a1416 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:21.272291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1190/2422] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:24.312836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71799aae-63e2-4370-b151-b3d48a8bc861 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:24.313354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71799aae-63e2-4370-b151-b3d48a8bc861 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:24.313354 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71799aae-63e2-4370-b151-b3d48a8bc861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:24.333607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-71799aae-63e2-4370-b151-b3d48a8bc861 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:24.334867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-71799aae-63e2-4370-b151-b3d48a8bc861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:24.343448 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1233/2423] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:24.394690 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63010c-d738-4eaa-9907-954d419a1416 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:24.407931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63010c-d738-4eaa-9907-954d419a1416 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:24.416867 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087e8e8-3a04-4eeb-a7b0-c434da26b6ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:24.417422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087e8e8-3a04-4eeb-a7b0-c434da26b6ea service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:24.417702 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087e8e8-3a04-4eeb-a7b0-c434da26b6ea service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:24.417967 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087e8e8-3a04-4eeb-a7b0-c434da26b6ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:24.427061 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087e8e8-3a04-4eeb-a7b0-c434da26b6ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:24.428658 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087e8e8-3a04-4eeb-a7b0-c434da26b6ea service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:24.439170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1191/2424] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:27.490195 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0955d0-308a-451e-ac02-753bd4a616b8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:27.491020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0955d0-308a-451e-ac02-753bd4a616b8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:27.491020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0955d0-308a-451e-ac02-753bd4a616b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:27.517331 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-af0955d0-308a-451e-ac02-753bd4a616b8 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:27.518547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-af0955d0-308a-451e-ac02-753bd4a616b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:27.527920 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1234/2425] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:27.551126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087e8e8-3a04-4eeb-a7b0-c434da26b6ea service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:27.562642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087e8e8-3a04-4eeb-a7b0-c434da26b6ea service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:27.568550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb5b5-be33-449a-9e58-1d4cb492a5e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:27.569158 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb5b5-be33-449a-9e58-1d4cb492a5e1 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:27.569438 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb5b5-be33-449a-9e58-1d4cb492a5e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:27.569705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb5b5-be33-449a-9e58-1d4cb492a5e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:27.578110 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceb5b5-be33-449a-9e58-1d4cb492a5e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:27.579699 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceb5b5-be33-449a-9e58-1d4cb492a5e1 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:27.589236 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1192/2426] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:31.166414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0955d0-308a-451e-ac02-753bd4a616b8 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:31.167976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-af0955d0-308a-451e-ac02-753bd4a616b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:31.181211 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0955d0-308a-451e-ac02-753bd4a616b8 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:31.185972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:31.186645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:31.186971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:31.187244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] PATH_INFO: `/v3/users/cdaa7f35aa2a45d7acfc9a00d63a6d2b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:31.188368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdaa7f35aa2a45d7acfc9a00d63a6d2b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:31.190311 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:31.238430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdaa7f35aa2a45d7acfc9a00d63a6d2b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.248294 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdaa7f35aa2a45d7acfc9a00d63a6d2b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.255507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdaa7f35aa2a45d7acfc9a00d63a6d2b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.256143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdaa7f35aa2a45d7acfc9a00d63a6d2b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.261727 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:31.278204 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ffabcee-2119-4a0a-9731-d98125bfb23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdaa7f35aa2a45d7acfc9a00d63a6d2b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.285149 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1235/2427] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:32:31 2022] DELETE /identity/v3/users/cdaa7f35aa2a45d7acfc9a00d63a6d2b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:32:31.467218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb5b5-be33-449a-9e58-1d4cb492a5e1 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:31.483208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb5b5-be33-449a-9e58-1d4cb492a5e1 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:31.540406 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:31.541066 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:31.541339 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:31.541610 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] PATH_INFO: `/v3/projects/fb598d3ee76240ca9fcceddf9670b64e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:31.542732 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb598d3ee76240ca9fcceddf9670b64e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:31.544764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:31.590929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb598d3ee76240ca9fcceddf9670b64e', 'request_id': 'req-51808327-d95d-4040-a590-c0ef3791e602'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.599163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb598d3ee76240ca9fcceddf9670b64e', 'request_id': 'req-51808327-d95d-4040-a590-c0ef3791e602'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.605161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb598d3ee76240ca9fcceddf9670b64e', 'request_id': 'req-51808327-d95d-4040-a590-c0ef3791e602'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.617659 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] The token cache is being invalidate because project fb598d3ee76240ca9fcceddf9670b64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:31.617941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.618567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-51808327-d95d-4040-a590-c0ef3791e602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:31.620172 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1193/2428] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:32:31 2022] DELETE /identity/v3/projects/fb598d3ee76240ca9fcceddf9670b64e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:31.625192 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39dac-4115-4674-8efc-8f1731c0e706 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:31.625475 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39dac-4115-4674-8efc-8f1731c0e706 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:31.625749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39dac-4115-4674-8efc-8f1731c0e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:31.646765 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-66e39dac-4115-4674-8efc-8f1731c0e706 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:31.647948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-66e39dac-4115-4674-8efc-8f1731c0e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:31.716230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1236/2429] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:31.724644 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301c875-54b5-4c82-9547-05792d6f4659 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:31.724900 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301c875-54b5-4c82-9547-05792d6f4659 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:31.725194 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301c875-54b5-4c82-9547-05792d6f4659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:31.747432 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a301c875-54b5-4c82-9547-05792d6f4659 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:31.748642 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a301c875-54b5-4c82-9547-05792d6f4659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:31.758205 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1194/2430] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:31.762853 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e39dac-4115-4674-8efc-8f1731c0e706 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:31.773584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e39dac-4115-4674-8efc-8f1731c0e706 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:31.779791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d2ee1-f322-49d8-8692-7708ae5f895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:31.780404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d2ee1-f322-49d8-8692-7708ae5f895d admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:31.780680 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d2ee1-f322-49d8-8692-7708ae5f895d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:31.780949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d2ee1-f322-49d8-8692-7708ae5f895d admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:31.781602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d2ee1-f322-49d8-8692-7708ae5f895d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:31.781919 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d2ee1-f322-49d8-8692-7708ae5f895d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:31.783563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d2ee1-f322-49d8-8692-7708ae5f895d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:31.797541 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1237/2431] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:31.801915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301c875-54b5-4c82-9547-05792d6f4659 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:31.811945 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301c875-54b5-4c82-9547-05792d6f4659 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:31.817813 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0716fa-5378-445a-83ca-7ca0bcece039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:31.818418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0716fa-5378-445a-83ca-7ca0bcece039 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:31.818694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0716fa-5378-445a-83ca-7ca0bcece039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:31.819008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0716fa-5378-445a-83ca-7ca0bcece039 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:31.819628 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0716fa-5378-445a-83ca-7ca0bcece039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:31.821552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0716fa-5378-445a-83ca-7ca0bcece039 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:31.838678 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:31.855825 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1195/2432] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:32:31 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:31.860149 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d2ee1-f322-49d8-8692-7708ae5f895d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:31.870954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d2ee1-f322-49d8-8692-7708ae5f895d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:31.930259 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f52be-9428-435f-823f-1621a97fd555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:31.930911 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f52be-9428-435f-823f-1621a97fd555 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:31.931213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f52be-9428-435f-823f-1621a97fd555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:31.931458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f52be-9428-435f-823f-1621a97fd555 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:31.932085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f52be-9428-435f-823f-1621a97fd555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:31.933983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f52be-9428-435f-823f-1621a97fd555 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:31.960542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1238/2433] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:32:31 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:31.961668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0716fa-5378-445a-83ca-7ca0bcece039 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:31.973737 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0716fa-5378-445a-83ca-7ca0bcece039 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:31.979330 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc633d-36cc-48e3-bded-d623fe6ff09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:31.979949 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc633d-36cc-48e3-bded-d623fe6ff09e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:31.980232 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc633d-36cc-48e3-bded-d623fe6ff09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:31.980503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc633d-36cc-48e3-bded-d623fe6ff09e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:31.981149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc633d-36cc-48e3-bded-d623fe6ff09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:31.982765 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc633d-36cc-48e3-bded-d623fe6ff09e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:31.995313 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1196/2434] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:32.000588 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f52be-9428-435f-823f-1621a97fd555 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.011518 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f52be-9428-435f-823f-1621a97fd555 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.017468 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397644dd-2bcd-42ee-bfff-64e4a018d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.018103 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397644dd-2bcd-42ee-bfff-64e4a018d1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.018402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397644dd-2bcd-42ee-bfff-64e4a018d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.018778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397644dd-2bcd-42ee-bfff-64e4a018d1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.019489 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397644dd-2bcd-42ee-bfff-64e4a018d1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:32.021452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397644dd-2bcd-42ee-bfff-64e4a018d1e3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:32.033505 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1239/2435] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:32.037979 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc633d-36cc-48e3-bded-d623fe6ff09e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.050226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc633d-36cc-48e3-bded-d623fe6ff09e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.055582 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8833fc-8a44-4921-8479-5b9ddc939e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.056301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8833fc-8a44-4921-8479-5b9ddc939e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.056596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8833fc-8a44-4921-8479-5b9ddc939e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.056854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8833fc-8a44-4921-8479-5b9ddc939e64 admin admin] PATH_INFO: `/v3/projects/863da3c6cbf248f482ca485377b5470c/users/cd0c8478ebbe4883862ed8f04ac6a3df/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.071513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8833fc-8a44-4921-8479-5b9ddc939e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863da3c6cbf248f482ca485377b5470c, user_id=cd0c8478ebbe4883862ed8f04ac6a3df, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:32.074169 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8833fc-8a44-4921-8479-5b9ddc939e64 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:32.087285 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1197/2436] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:32:32 2022] PUT /identity/v3/projects/863da3c6cbf248f482ca485377b5470c/users/cd0c8478ebbe4883862ed8f04ac6a3df/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:32.097960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e65be-1334-4018-8331-8dd2e739dc31 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.098288 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e65be-1334-4018-8331-8dd2e739dc31 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.098563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e65be-1334-4018-8331-8dd2e739dc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.127695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-160e65be-1334-4018-8331-8dd2e739dc31 None None] MFA Rules not processed for user `cd0c8478ebbe4883862ed8f04ac6a3df`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:32.128895 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-160e65be-1334-4018-8331-8dd2e739dc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:32.171207 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:32.196486 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1240/2437] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:32.202290 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8833fc-8a44-4921-8479-5b9ddc939e64 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.263473 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8833fc-8a44-4921-8479-5b9ddc939e64 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.269814 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c474f-5caa-44b8-9cb7-485e4a1b28a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.270429 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c474f-5caa-44b8-9cb7-485e4a1b28a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.270708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c474f-5caa-44b8-9cb7-485e4a1b28a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.271022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c474f-5caa-44b8-9cb7-485e4a1b28a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.271651 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c474f-5caa-44b8-9cb7-485e4a1b28a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:32.273546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c474f-5caa-44b8-9cb7-485e4a1b28a5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:32.303722 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1198/2438] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:32:32 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:32.307981 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e65be-1334-4018-8331-8dd2e739dc31 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.319512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e65be-1334-4018-8331-8dd2e739dc31 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.379816 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829c7a-faf2-4b71-8189-ff06498e664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.380517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829c7a-faf2-4b71-8189-ff06498e664d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.380867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829c7a-faf2-4b71-8189-ff06498e664d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.381142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829c7a-faf2-4b71-8189-ff06498e664d admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.381806 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829c7a-faf2-4b71-8189-ff06498e664d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:32.383818 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829c7a-faf2-4b71-8189-ff06498e664d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:32.409228 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1241/2439] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:32:32 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:32.410433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c474f-5caa-44b8-9cb7-485e4a1b28a5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.420745 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c474f-5caa-44b8-9cb7-485e4a1b28a5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.426480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44521e-3218-4d69-bc92-f9fc4a76b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.426806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44521e-3218-4d69-bc92-f9fc4a76b2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.427085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44521e-3218-4d69-bc92-f9fc4a76b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.427364 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44521e-3218-4d69-bc92-f9fc4a76b2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.427991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44521e-3218-4d69-bc92-f9fc4a76b2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:32.429584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44521e-3218-4d69-bc92-f9fc4a76b2f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:32.440990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1199/2440] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:32.445296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829c7a-faf2-4b71-8189-ff06498e664d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.455957 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829c7a-faf2-4b71-8189-ff06498e664d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.461676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd52ac-d1f8-4ece-865a-5aac3ededdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.462342 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd52ac-d1f8-4ece-865a-5aac3ededdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.462708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd52ac-d1f8-4ece-865a-5aac3ededdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.462983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd52ac-d1f8-4ece-865a-5aac3ededdaf admin admin] PATH_INFO: `/v3/projects/f313286eba4c403680f5293a635c512c/users/896fba098d2f4e388d13dea50084b2ef/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.478442 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd52ac-d1f8-4ece-865a-5aac3ededdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f313286eba4c403680f5293a635c512c, user_id=896fba098d2f4e388d13dea50084b2ef, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:32.481153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd52ac-d1f8-4ece-865a-5aac3ededdaf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:32.496137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1242/2441] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:32:32 2022] PUT /identity/v3/projects/f313286eba4c403680f5293a635c512c/users/896fba098d2f4e388d13dea50084b2ef/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:32.500255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44521e-3218-4d69-bc92-f9fc4a76b2f6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.510505 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44521e-3218-4d69-bc92-f9fc4a76b2f6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.569633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f0d6-09e6-46cd-9da2-ddf1a2b0fc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.570154 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f0d6-09e6-46cd-9da2-ddf1a2b0fc42 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.570430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f0d6-09e6-46cd-9da2-ddf1a2b0fc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.570701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f0d6-09e6-46cd-9da2-ddf1a2b0fc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.571361 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3f0d6-09e6-46cd-9da2-ddf1a2b0fc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:32.573019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3f0d6-09e6-46cd-9da2-ddf1a2b0fc42 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:32.586163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1200/2442] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:32.587391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd52ac-d1f8-4ece-865a-5aac3ededdaf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.597704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd52ac-d1f8-4ece-865a-5aac3ededdaf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.602535 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abddc35-6575-4ec2-8951-6e5107cafa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.603330 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abddc35-6575-4ec2-8951-6e5107cafa34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.603637 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abddc35-6575-4ec2-8951-6e5107cafa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.603926 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abddc35-6575-4ec2-8951-6e5107cafa34 admin admin] PATH_INFO: `/v3/projects/f313286eba4c403680f5293a635c512c/users/896fba098d2f4e388d13dea50084b2ef/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.606233 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abddc35-6575-4ec2-8951-6e5107cafa34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f313286eba4c403680f5293a635c512c, user_id=896fba098d2f4e388d13dea50084b2ef, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:32.609178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abddc35-6575-4ec2-8951-6e5107cafa34 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:32.620000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1243/2443] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:32:32 2022] PUT /identity/v3/projects/f313286eba4c403680f5293a635c512c/users/896fba098d2f4e388d13dea50084b2ef/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:32.632193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847eceb-029b-4fd8-839a-0cc9844516fa None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.632483 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847eceb-029b-4fd8-839a-0cc9844516fa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.632753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847eceb-029b-4fd8-839a-0cc9844516fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.663521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8847eceb-029b-4fd8-839a-0cc9844516fa None None] MFA Rules not processed for user `896fba098d2f4e388d13dea50084b2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:32.664752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8847eceb-029b-4fd8-839a-0cc9844516fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:32.684261 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:32.736655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1201/2444] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:32.749379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abddc35-6575-4ec2-8951-6e5107cafa34 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.751695 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1abddc35-6575-4ec2-8951-6e5107cafa34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:32.833959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abddc35-6575-4ec2-8951-6e5107cafa34 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.838214 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff8bf-3f3c-4bfd-96d4-93ef9d0e5c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.838882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff8bf-3f3c-4bfd-96d4-93ef9d0e5c1f service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.839155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff8bf-3f3c-4bfd-96d4-93ef9d0e5c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.839422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff8bf-3f3c-4bfd-96d4-93ef9d0e5c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:32.850074 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dff8bf-3f3c-4bfd-96d4-93ef9d0e5c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:32.851527 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dff8bf-3f3c-4bfd-96d4-93ef9d0e5c1f service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:32.861521 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1244/2445] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:32.950643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847eceb-029b-4fd8-839a-0cc9844516fa None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:32.961366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847eceb-029b-4fd8-839a-0cc9844516fa None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:32.965594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953a02d-d6aa-4af6-8e2a-5bd405197646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:32.966209 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953a02d-d6aa-4af6-8e2a-5bd405197646 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:32.966486 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953a02d-d6aa-4af6-8e2a-5bd405197646 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:32.966787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953a02d-d6aa-4af6-8e2a-5bd405197646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:33.031251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953a02d-d6aa-4af6-8e2a-5bd405197646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:33.032687 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953a02d-d6aa-4af6-8e2a-5bd405197646 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:33.042005 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1202/2446] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:37.843169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff8bf-3f3c-4bfd-96d4-93ef9d0e5c1f service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:37.862652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:37.917904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff8bf-3f3c-4bfd-96d4-93ef9d0e5c1f service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:37.922200 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:37.923080 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.923422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.923755 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] PATH_INFO: `/v3/users/cd0c8478ebbe4883862ed8f04ac6a3df` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.925016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0c8478ebbe4883862ed8f04ac6a3df)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:37.935123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:38.008155 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0c8478ebbe4883862ed8f04ac6a3df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.018946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0c8478ebbe4883862ed8f04ac6a3df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.027159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0c8478ebbe4883862ed8f04ac6a3df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.027881 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0c8478ebbe4883862ed8f04ac6a3df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.048065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0c8478ebbe4883862ed8f04ac6a3df'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.054644 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1245/2447] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:32:37 2022] DELETE /identity/v3/users/cd0c8478ebbe4883862ed8f04ac6a3df => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:38.059542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106f247-4fc4-42c8-95dc-0cbf91423666 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:38.060049 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106f247-4fc4-42c8-95dc-0cbf91423666 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:38.060157 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106f247-4fc4-42c8-95dc-0cbf91423666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:38.079251 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2106f247-4fc4-42c8-95dc-0cbf91423666 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:38.080481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2106f247-4fc4-42c8-95dc-0cbf91423666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:38.139735 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1203/2448] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:38.149770 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:38.151408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:38.230658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d1d30-e410-4802-afac-84488bc924e7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:38.235304 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62370f-cc45-4898-a7be-0e74cef3da2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:38.235645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62370f-cc45-4898-a7be-0e74cef3da2f service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:38.235922 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62370f-cc45-4898-a7be-0e74cef3da2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:38.236193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62370f-cc45-4898-a7be-0e74cef3da2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:38.248133 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62370f-cc45-4898-a7be-0e74cef3da2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:38.249561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62370f-cc45-4898-a7be-0e74cef3da2f service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:38.259565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1246/2449] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:38.529244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106f247-4fc4-42c8-95dc-0cbf91423666 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:38.530823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2106f247-4fc4-42c8-95dc-0cbf91423666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:38.543466 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106f247-4fc4-42c8-95dc-0cbf91423666 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:38.548457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:38.549181 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:38.549522 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:38.549859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] PATH_INFO: `/v3/projects/863da3c6cbf248f482ca485377b5470c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:38.551133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863da3c6cbf248f482ca485377b5470c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:38.553065 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:38.605176 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863da3c6cbf248f482ca485377b5470c', 'request_id': 'req-d6c65888-fb81-4380-806e-fd9d7578a4b0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.608164 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:38.616177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863da3c6cbf248f482ca485377b5470c', 'request_id': 'req-d6c65888-fb81-4380-806e-fd9d7578a4b0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.622692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863da3c6cbf248f482ca485377b5470c', 'request_id': 'req-d6c65888-fb81-4380-806e-fd9d7578a4b0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.634174 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] The token cache is being invalidate because project 863da3c6cbf248f482ca485377b5470c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:38.634463 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.635229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.636785 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1204/2450] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:32:38 2022] DELETE /identity/v3/projects/863da3c6cbf248f482ca485377b5470c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:38.640822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62370f-cc45-4898-a7be-0e74cef3da2f service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:38.654768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62370f-cc45-4898-a7be-0e74cef3da2f service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:38.671912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:38.714805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:38.715445 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:38.715723 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:38.715974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] PATH_INFO: `/v3/users/896fba098d2f4e388d13dea50084b2ef` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:38.717143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896fba098d2f4e388d13dea50084b2ef)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:38.719118 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:38.768001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896fba098d2f4e388d13dea50084b2ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.776688 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896fba098d2f4e388d13dea50084b2ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.783538 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896fba098d2f4e388d13dea50084b2ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.784170 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896fba098d2f4e388d13dea50084b2ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.796022 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bbd25928-2d62-4a1c-acc0-20305ff1aed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896fba098d2f4e388d13dea50084b2ef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:38.801785 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1247/2451] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:32:38 2022] DELETE /identity/v3/users/896fba098d2f4e388d13dea50084b2ef => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:39.079143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.080700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:39.105528 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c65888-fb81-4380-806e-fd9d7578a4b0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.169575 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.170227 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.170504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.170820 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] PATH_INFO: `/v3/projects/f313286eba4c403680f5293a635c512c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.172099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f313286eba4c403680f5293a635c512c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:39.174267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:39.222866 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f313286eba4c403680f5293a635c512c', 'request_id': 'req-c9ad09de-77a2-4246-a508-7d252b3ba169'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.231265 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f313286eba4c403680f5293a635c512c', 'request_id': 'req-c9ad09de-77a2-4246-a508-7d252b3ba169'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.242203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f313286eba4c403680f5293a635c512c', 'request_id': 'req-c9ad09de-77a2-4246-a508-7d252b3ba169'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.249992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] The token cache is being invalidate because project f313286eba4c403680f5293a635c512c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:39.250755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.251294 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c9ad09de-77a2-4246-a508-7d252b3ba169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.253030 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1205/2452] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:32:39 2022] DELETE /identity/v3/projects/f313286eba4c403680f5293a635c512c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:32:39.258393 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858dad9-62bf-463e-b5dc-ed005dce2904 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.258813 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858dad9-62bf-463e-b5dc-ed005dce2904 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.259098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858dad9-62bf-463e-b5dc-ed005dce2904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.280301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8858dad9-62bf-463e-b5dc-ed005dce2904 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:39.281517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8858dad9-62bf-463e-b5dc-ed005dce2904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:39.344135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1248/2453] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:39.352202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0dd3a-ac67-493c-8ba2-fdf256c37633 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.352492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0dd3a-ac67-493c-8ba2-fdf256c37633 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.352763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0dd3a-ac67-493c-8ba2-fdf256c37633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.374966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-81c0dd3a-ac67-493c-8ba2-fdf256c37633 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:39.376025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-81c0dd3a-ac67-493c-8ba2-fdf256c37633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:39.384803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1206/2454] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:39.389559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858dad9-62bf-463e-b5dc-ed005dce2904 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.399360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858dad9-62bf-463e-b5dc-ed005dce2904 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.404173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e14465-7fe9-4d18-a72a-18a9f5c3e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.404780 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e14465-7fe9-4d18-a72a-18a9f5c3e948 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.405068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e14465-7fe9-4d18-a72a-18a9f5c3e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.405332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e14465-7fe9-4d18-a72a-18a9f5c3e948 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.406029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e14465-7fe9-4d18-a72a-18a9f5c3e948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:39.406290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e14465-7fe9-4d18-a72a-18a9f5c3e948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:39.407904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e14465-7fe9-4d18-a72a-18a9f5c3e948 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:39.419540 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1249/2455] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:39.423899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0dd3a-ac67-493c-8ba2-fdf256c37633 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.433756 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0dd3a-ac67-493c-8ba2-fdf256c37633 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.439570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89643fc-5523-4210-a763-27354b734504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.440189 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89643fc-5523-4210-a763-27354b734504 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.440496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89643fc-5523-4210-a763-27354b734504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.440894 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89643fc-5523-4210-a763-27354b734504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.441561 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89643fc-5523-4210-a763-27354b734504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:39.443944 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89643fc-5523-4210-a763-27354b734504 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:39.473729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1207/2456] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:32:39 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:39.477994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e14465-7fe9-4d18-a72a-18a9f5c3e948 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.489936 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e14465-7fe9-4d18-a72a-18a9f5c3e948 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.515081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:39.549562 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be5aea-152e-4b32-8dd2-31ca45666690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.550173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be5aea-152e-4b32-8dd2-31ca45666690 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.550452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be5aea-152e-4b32-8dd2-31ca45666690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.550734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be5aea-152e-4b32-8dd2-31ca45666690 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.551402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be5aea-152e-4b32-8dd2-31ca45666690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:39.553332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be5aea-152e-4b32-8dd2-31ca45666690 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:39.574168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1250/2457] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:32:39 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:32:39.578663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89643fc-5523-4210-a763-27354b734504 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.589572 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89643fc-5523-4210-a763-27354b734504 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.595660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939240-9be2-4783-9b6c-acf063193c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.596210 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939240-9be2-4783-9b6c-acf063193c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.596492 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939240-9be2-4783-9b6c-acf063193c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.596762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939240-9be2-4783-9b6c-acf063193c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.597412 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d939240-9be2-4783-9b6c-acf063193c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:39.599069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d939240-9be2-4783-9b6c-acf063193c2e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:39.610456 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1208/2458] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:39.615327 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be5aea-152e-4b32-8dd2-31ca45666690 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.625971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be5aea-152e-4b32-8dd2-31ca45666690 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.631048 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006291-d33f-45d5-97b6-6ca2a480df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.631783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006291-d33f-45d5-97b6-6ca2a480df23 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.632068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006291-d33f-45d5-97b6-6ca2a480df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.632375 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006291-d33f-45d5-97b6-6ca2a480df23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.633020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006291-d33f-45d5-97b6-6ca2a480df23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:39.634625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006291-d33f-45d5-97b6-6ca2a480df23 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:39.647130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1251/2459] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:32:39.652632 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939240-9be2-4783-9b6c-acf063193c2e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.663458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939240-9be2-4783-9b6c-acf063193c2e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.669199 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37facca1-925e-454d-9e7e-998fc0981b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.669856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37facca1-925e-454d-9e7e-998fc0981b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.670134 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37facca1-925e-454d-9e7e-998fc0981b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.670402 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37facca1-925e-454d-9e7e-998fc0981b1b admin admin] PATH_INFO: `/v3/projects/169b1ec1af0a4e5db28235dec070eeb6/users/0f294f66fe3b48d794b6a817d3e01bea/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.685854 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37facca1-925e-454d-9e7e-998fc0981b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=169b1ec1af0a4e5db28235dec070eeb6, user_id=0f294f66fe3b48d794b6a817d3e01bea, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:39.688555 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37facca1-925e-454d-9e7e-998fc0981b1b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:39.705789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1209/2460] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:32:39 2022] PUT /identity/v3/projects/169b1ec1af0a4e5db28235dec070eeb6/users/0f294f66fe3b48d794b6a817d3e01bea/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:39.717673 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e9e0f-25c0-430a-b71c-3b6d12681d61 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.717959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e9e0f-25c0-430a-b71c-3b6d12681d61 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.718232 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e9e0f-25c0-430a-b71c-3b6d12681d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.746766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-175e9e0f-25c0-430a-b71c-3b6d12681d61 None None] MFA Rules not processed for user `0f294f66fe3b48d794b6a817d3e01bea`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:39.748006 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-175e9e0f-25c0-430a-b71c-3b6d12681d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:39.815002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1252/2461] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:39.819691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37facca1-925e-454d-9e7e-998fc0981b1b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.825812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:39.886434 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37facca1-925e-454d-9e7e-998fc0981b1b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.891581 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177b0f-fc50-4c58-91d6-a0fc75c6d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.892167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177b0f-fc50-4c58-91d6-a0fc75c6d22f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.892560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177b0f-fc50-4c58-91d6-a0fc75c6d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.892840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177b0f-fc50-4c58-91d6-a0fc75c6d22f admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.893452 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13177b0f-fc50-4c58-91d6-a0fc75c6d22f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:39.895408 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13177b0f-fc50-4c58-91d6-a0fc75c6d22f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:39.923379 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1210/2462] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:32:39 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:39.927608 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e9e0f-25c0-430a-b71c-3b6d12681d61 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.938563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e9e0f-25c0-430a-b71c-3b6d12681d61 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.996477 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9f334-34fa-4e56-8106-c3f41b4b1e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.997067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9f334-34fa-4e56-8106-c3f41b4b1e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.997347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9f334-34fa-4e56-8106-c3f41b4b1e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.997612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9f334-34fa-4e56-8106-c3f41b4b1e5a admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.998248 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9f334-34fa-4e56-8106-c3f41b4b1e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:40.000169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9f334-34fa-4e56-8106-c3f41b4b1e5a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:40.023499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1253/2463] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:32:39 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:40.027971 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177b0f-fc50-4c58-91d6-a0fc75c6d22f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:40.038705 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177b0f-fc50-4c58-91d6-a0fc75c6d22f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:40.044504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58473c-ca2e-47b4-a179-d9f63ab6e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:40.045121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58473c-ca2e-47b4-a179-d9f63ab6e5da admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.045387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58473c-ca2e-47b4-a179-d9f63ab6e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.045668 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58473c-ca2e-47b4-a179-d9f63ab6e5da admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.046311 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58473c-ca2e-47b4-a179-d9f63ab6e5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:40.047969 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58473c-ca2e-47b4-a179-d9f63ab6e5da admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:40.059457 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1211/2464] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:40.064063 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9f334-34fa-4e56-8106-c3f41b4b1e5a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:40.074230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9f334-34fa-4e56-8106-c3f41b4b1e5a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:40.079430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530eca3-0aa7-4569-84f8-13c407003104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:40.080082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530eca3-0aa7-4569-84f8-13c407003104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.080355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530eca3-0aa7-4569-84f8-13c407003104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.080623 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530eca3-0aa7-4569-84f8-13c407003104 admin admin] PATH_INFO: `/v3/projects/5750e3e731834577975bdd7ce94af038/users/19b7bc2120a542d1a0794df4d4985337/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.096410 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530eca3-0aa7-4569-84f8-13c407003104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5750e3e731834577975bdd7ce94af038, user_id=19b7bc2120a542d1a0794df4d4985337, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:40.099075 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530eca3-0aa7-4569-84f8-13c407003104 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:40.109274 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:40.115261 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1254/2465] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:32:40 2022] PUT /identity/v3/projects/5750e3e731834577975bdd7ce94af038/users/19b7bc2120a542d1a0794df4d4985337/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:32:40.121220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58473c-ca2e-47b4-a179-d9f63ab6e5da admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:40.136327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58473c-ca2e-47b4-a179-d9f63ab6e5da admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:40.196009 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92771e6a-880e-48e6-bde2-65dd9f95a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:40.196546 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92771e6a-880e-48e6-bde2-65dd9f95a1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.196884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92771e6a-880e-48e6-bde2-65dd9f95a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.197153 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92771e6a-880e-48e6-bde2-65dd9f95a1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.197806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92771e6a-880e-48e6-bde2-65dd9f95a1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:40.199504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92771e6a-880e-48e6-bde2-65dd9f95a1d7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:40.209593 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1212/2466] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:40.213944 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530eca3-0aa7-4569-84f8-13c407003104 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:40.224561 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530eca3-0aa7-4569-84f8-13c407003104 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:40.229705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b516281-38b4-482a-9414-f751fc39a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:40.230362 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b516281-38b4-482a-9414-f751fc39a215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.230651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b516281-38b4-482a-9414-f751fc39a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.230949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b516281-38b4-482a-9414-f751fc39a215 admin admin] PATH_INFO: `/v3/projects/5750e3e731834577975bdd7ce94af038/users/19b7bc2120a542d1a0794df4d4985337/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.232987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b516281-38b4-482a-9414-f751fc39a215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5750e3e731834577975bdd7ce94af038, user_id=19b7bc2120a542d1a0794df4d4985337, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:40.235641 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b516281-38b4-482a-9414-f751fc39a215 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:40.248602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1255/2467] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:32:40 2022] PUT /identity/v3/projects/5750e3e731834577975bdd7ce94af038/users/19b7bc2120a542d1a0794df4d4985337/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:40.259853 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dffdf-de76-4585-8f92-564c047226d5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.260279 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dffdf-de76-4585-8f92-564c047226d5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.260686 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dffdf-de76-4585-8f92-564c047226d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.290426 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8a5dffdf-de76-4585-8f92-564c047226d5 None None] MFA Rules not processed for user `19b7bc2120a542d1a0794df4d4985337`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:40.291734 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8a5dffdf-de76-4585-8f92-564c047226d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:40.365022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:40.370861 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1213/2468] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:40.380000 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b516281-38b4-482a-9414-f751fc39a215 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:40.381744 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5b516281-38b4-482a-9414-f751fc39a215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:40.439440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b516281-38b4-482a-9414-f751fc39a215 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:40.443480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077470c-b6ae-4fa8-9bce-910791f7517e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:40.444296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077470c-b6ae-4fa8-9bce-910791f7517e service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.445734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077470c-b6ae-4fa8-9bce-910791f7517e service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.446119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077470c-b6ae-4fa8-9bce-910791f7517e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.456598 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077470c-b6ae-4fa8-9bce-910791f7517e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:40.458051 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077470c-b6ae-4fa8-9bce-910791f7517e service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:40.468862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1256/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:41.033301 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dffdf-de76-4585-8f92-564c047226d5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:41.097407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dffdf-de76-4585-8f92-564c047226d5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:41.102218 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:41.102885 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:41.103163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:41.103436 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] PATH_INFO: `/v3/users/0f294f66fe3b48d794b6a817d3e01bea` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:41.104594 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f294f66fe3b48d794b6a817d3e01bea)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:41.106599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:41.155609 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f294f66fe3b48d794b6a817d3e01bea'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:41.162563 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f294f66fe3b48d794b6a817d3e01bea'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:41.174462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f294f66fe3b48d794b6a817d3e01bea'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:41.184689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f294f66fe3b48d794b6a817d3e01bea'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:41.185423 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f294f66fe3b48d794b6a817d3e01bea'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:41.191587 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1214/2470] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:32:41 2022] DELETE /identity/v3/users/0f294f66fe3b48d794b6a817d3e01bea => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:41.196367 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537ef4a-41ac-4a5f-a09f-4f0e720da695 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:41.196651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537ef4a-41ac-4a5f-a09f-4f0e720da695 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:41.196945 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537ef4a-41ac-4a5f-a09f-4f0e720da695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:41.217133 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3537ef4a-41ac-4a5f-a09f-4f0e720da695 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:41.218265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3537ef4a-41ac-4a5f-a09f-4f0e720da695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:41.280670 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1257/2471] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:41.290855 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:41.292467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:41.352907 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b752a82-5ba7-4b1f-a6a4-5a368f620963 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:41.357394 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6bea-1fd8-48fa-8a0b-3c831bcbbd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:41.358008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6bea-1fd8-48fa-8a0b-3c831bcbbd3e service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:41.358289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6bea-1fd8-48fa-8a0b-3c831bcbbd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:41.358569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e6bea-1fd8-48fa-8a0b-3c831bcbbd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:41.369254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e6bea-1fd8-48fa-8a0b-3c831bcbbd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:41.370816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e6bea-1fd8-48fa-8a0b-3c831bcbbd3e service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:41.380807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1215/2472] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:41.893335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537ef4a-41ac-4a5f-a09f-4f0e720da695 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:41.894815 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3537ef4a-41ac-4a5f-a09f-4f0e720da695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:41.907222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537ef4a-41ac-4a5f-a09f-4f0e720da695 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:41.912783 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:41.913817 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:41.914182 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:41.915061 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] PATH_INFO: `/v3/projects/169b1ec1af0a4e5db28235dec070eeb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:41.916537 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=169b1ec1af0a4e5db28235dec070eeb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:41.919301 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:41.970245 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169b1ec1af0a4e5db28235dec070eeb6', 'request_id': 'req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:41.976517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169b1ec1af0a4e5db28235dec070eeb6', 'request_id': 'req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:41.983092 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169b1ec1af0a4e5db28235dec070eeb6', 'request_id': 'req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:41.997726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] The token cache is being invalidate because project 169b1ec1af0a4e5db28235dec070eeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:41.998016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:41.998660 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.000191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1258/2473] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:32:41 2022] DELETE /identity/v3/projects/169b1ec1af0a4e5db28235dec070eeb6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:42.004467 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6bea-1fd8-48fa-8a0b-3c831bcbbd3e service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.014054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e6bea-1fd8-48fa-8a0b-3c831bcbbd3e service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.032091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:42.072178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.072865 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.073149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.073422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] PATH_INFO: `/v3/users/19b7bc2120a542d1a0794df4d4985337` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.074604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b7bc2120a542d1a0794df4d4985337)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.076629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.122772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b7bc2120a542d1a0794df4d4985337'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.129774 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b7bc2120a542d1a0794df4d4985337'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.142180 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b7bc2120a542d1a0794df4d4985337'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.151387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b7bc2120a542d1a0794df4d4985337'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.152145 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34b51d45-2a94-4b30-8415-e0a095f83b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b7bc2120a542d1a0794df4d4985337'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.158371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1216/2474] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:32:42 2022] DELETE /identity/v3/users/19b7bc2120a542d1a0794df4d4985337 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:42.432423 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.434005 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.447472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9a9b-8259-44e6-ad49-dc1ff78ed21c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.458070 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:42.511627 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.512244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.512525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.512834 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] PATH_INFO: `/v3/projects/5750e3e731834577975bdd7ce94af038` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.513986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5750e3e731834577975bdd7ce94af038)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.515939 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.565283 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5750e3e731834577975bdd7ce94af038', 'request_id': 'req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.571058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5750e3e731834577975bdd7ce94af038', 'request_id': 'req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.577476 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5750e3e731834577975bdd7ce94af038', 'request_id': 'req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.590611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] The token cache is being invalidate because project 5750e3e731834577975bdd7ce94af038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:42.590932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.591584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe9e17fe-64ee-470c-91d7-3c2c86e9b9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.593159 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1259/2475] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:32:42 2022] DELETE /identity/v3/projects/5750e3e731834577975bdd7ce94af038 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:42.598178 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8286fe-3573-4d62-889e-c37650496a22 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.598468 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8286fe-3573-4d62-889e-c37650496a22 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.598760 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8286fe-3573-4d62-889e-c37650496a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.620740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5c8286fe-3573-4d62-889e-c37650496a22 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:42.621978 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5c8286fe-3573-4d62-889e-c37650496a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.681961 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1217/2476] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:42.690085 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab082f21-0932-4e84-a43a-f307d316f550 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.690391 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab082f21-0932-4e84-a43a-f307d316f550 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.690651 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab082f21-0932-4e84-a43a-f307d316f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.712128 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ab082f21-0932-4e84-a43a-f307d316f550 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:42.713419 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ab082f21-0932-4e84-a43a-f307d316f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.725610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1260/2477] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:42.727047 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8286fe-3573-4d62-889e-c37650496a22 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.737152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8286fe-3573-4d62-889e-c37650496a22 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.743091 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053e04e-ecaa-414b-ad77-518cfb45d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.743736 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e04e-ecaa-414b-ad77-518cfb45d7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.744099 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e04e-ecaa-414b-ad77-518cfb45d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.744305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e04e-ecaa-414b-ad77-518cfb45d7b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.746255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053e04e-ecaa-414b-ad77-518cfb45d7b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:42.746255 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053e04e-ecaa-414b-ad77-518cfb45d7b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.747022 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053e04e-ecaa-414b-ad77-518cfb45d7b1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.750105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fd1c1-e53e-453c-b9ac-af23f64c2925 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.750405 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fd1c1-e53e-453c-b9ac-af23f64c2925 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.750681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fd1c1-e53e-453c-b9ac-af23f64c2925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.759998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1218/2478] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:42.764246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053e04e-ecaa-414b-ad77-518cfb45d7b1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.770019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5e7fd1c1-e53e-453c-b9ac-af23f64c2925 None None] MFA Rules not processed for user `9208660dd7504213a1eee4e72abad956`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:42.771266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5e7fd1c1-e53e-453c-b9ac-af23f64c2925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.775728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053e04e-ecaa-414b-ad77-518cfb45d7b1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.780614 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818b88c-1558-4ec0-ab76-b829df6c271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.781200 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818b88c-1558-4ec0-ab76-b829df6c271c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.781510 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818b88c-1558-4ec0-ab76-b829df6c271c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.781780 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818b88c-1558-4ec0-ab76-b829df6c271c admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.782443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818b88c-1558-4ec0-ab76-b829df6c271c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.784314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818b88c-1558-4ec0-ab76-b829df6c271c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.813938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1219/2479] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:32:42 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:32:42.818683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818b88c-1558-4ec0-ab76-b829df6c271c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.827594 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1261/2480] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:42.827782 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:42.893843 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818b88c-1558-4ec0-ab76-b829df6c271c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.898511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087adf-c577-4fc0-8a33-82f44b83799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.899162 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087adf-c577-4fc0-8a33-82f44b83799f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.899439 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087adf-c577-4fc0-8a33-82f44b83799f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.899829 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087adf-c577-4fc0-8a33-82f44b83799f admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.900464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7087adf-c577-4fc0-8a33-82f44b83799f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.902475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7087adf-c577-4fc0-8a33-82f44b83799f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.929247 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1220/2481] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:32:42 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:32:42.930612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fd1c1-e53e-453c-b9ac-af23f64c2925 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.941557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fd1c1-e53e-453c-b9ac-af23f64c2925 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.946347 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01de79-fd1a-4200-a510-062d66f05386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.947076 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01de79-fd1a-4200-a510-062d66f05386 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.947422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01de79-fd1a-4200-a510-062d66f05386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.947808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01de79-fd1a-4200-a510-062d66f05386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.948514 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01de79-fd1a-4200-a510-062d66f05386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.950173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01de79-fd1a-4200-a510-062d66f05386 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.960440 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1262/2482] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:42.964501 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087adf-c577-4fc0-8a33-82f44b83799f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.975017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087adf-c577-4fc0-8a33-82f44b83799f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.980139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031852e-639b-4ec9-98d7-d20e90d36bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.980848 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031852e-639b-4ec9-98d7-d20e90d36bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.981128 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031852e-639b-4ec9-98d7-d20e90d36bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.981535 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031852e-639b-4ec9-98d7-d20e90d36bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.982186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031852e-639b-4ec9-98d7-d20e90d36bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.983812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031852e-639b-4ec9-98d7-d20e90d36bd1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.998549 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1221/2483] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:42.999792 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01de79-fd1a-4200-a510-062d66f05386 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:43.009883 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01de79-fd1a-4200-a510-062d66f05386 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:43.014824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2461f-2e65-4230-9a58-a8803f06ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:43.015474 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2461f-2e65-4230-9a58-a8803f06ecea admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:43.015768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2461f-2e65-4230-9a58-a8803f06ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:43.016027 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2461f-2e65-4230-9a58-a8803f06ecea admin admin] PATH_INFO: `/v3/projects/2b1e56e7f11a499e8ba0ee8431dc368e/users/78996354537d4906bf15a1307b06c84c/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:43.031031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2461f-2e65-4230-9a58-a8803f06ecea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1e56e7f11a499e8ba0ee8431dc368e, user_id=78996354537d4906bf15a1307b06c84c, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:43.033722 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2461f-2e65-4230-9a58-a8803f06ecea admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:43.048087 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1263/2484] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:32:42 2022] PUT /identity/v3/projects/2b1e56e7f11a499e8ba0ee8431dc368e/users/78996354537d4906bf15a1307b06c84c/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:43.053336 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c17459-1a75-4a68-8524-821edc93b7de None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:43.053988 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c17459-1a75-4a68-8524-821edc93b7de None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:43.054271 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c17459-1a75-4a68-8524-821edc93b7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:43.075362 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-52c17459-1a75-4a68-8524-821edc93b7de None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:43.076488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-52c17459-1a75-4a68-8524-821edc93b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:43.135905 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1222/2485] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:43.145931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2461f-2e65-4230-9a58-a8803f06ecea admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:43.147865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-22e2461f-2e65-4230-9a58-a8803f06ecea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:43.157977 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:43.209095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2461f-2e65-4230-9a58-a8803f06ecea admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:43.213418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafdf2-9016-4c29-8116-1bced6177fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:43.214044 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafdf2-9016-4c29-8116-1bced6177fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:43.214321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafdf2-9016-4c29-8116-1bced6177fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:43.214587 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafdf2-9016-4c29-8116-1bced6177fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:43.224095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dafdf2-9016-4c29-8116-1bced6177fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:43.225519 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dafdf2-9016-4c29-8116-1bced6177fe7 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:43.235830 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1264/2486] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:43.952482 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda92d-bc50-45d8-9987-22149a0ba440 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:43.953077 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda92d-bc50-45d8-9987-22149a0ba440 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:43.953077 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda92d-bc50-45d8-9987-22149a0ba440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:43.982746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cbcda92d-bc50-45d8-9987-22149a0ba440 None None] MFA Rules not processed for user `78996354537d4906bf15a1307b06c84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:43.984092 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cbcda92d-bc50-45d8-9987-22149a0ba440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:44.061851 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1223/2487] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:44.066551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafdf2-9016-4c29-8116-1bced6177fe7 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.076547 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafdf2-9016-4c29-8116-1bced6177fe7 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.081846 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170acc-d125-4b1e-b9ab-4b2821b0b9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.082467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170acc-d125-4b1e-b9ab-4b2821b0b9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.082798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170acc-d125-4b1e-b9ab-4b2821b0b9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.083031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170acc-d125-4b1e-b9ab-4b2821b0b9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.083674 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63170acc-d125-4b1e-b9ab-4b2821b0b9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.085597 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63170acc-d125-4b1e-b9ab-4b2821b0b9d2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.114890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1265/2488] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:32:44 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:32:44.119588 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda92d-bc50-45d8-9987-22149a0ba440 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.130807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda92d-bc50-45d8-9987-22149a0ba440 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.143906 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:44.190521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6691fc-e359-4906-8099-bd1923961d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.191193 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6691fc-e359-4906-8099-bd1923961d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.191469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6691fc-e359-4906-8099-bd1923961d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.191739 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6691fc-e359-4906-8099-bd1923961d60 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.192381 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6691fc-e359-4906-8099-bd1923961d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.194328 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6691fc-e359-4906-8099-bd1923961d60 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.217012 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1224/2489] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:32:44 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:44.221437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170acc-d125-4b1e-b9ab-4b2821b0b9d2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.236943 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170acc-d125-4b1e-b9ab-4b2821b0b9d2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.244723 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ee90-3263-49f1-ad9f-fc8b6580d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.245325 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ee90-3263-49f1-ad9f-fc8b6580d594 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.245600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ee90-3263-49f1-ad9f-fc8b6580d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.245864 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ee90-3263-49f1-ad9f-fc8b6580d594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.246503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62ee90-3263-49f1-ad9f-fc8b6580d594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.248117 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62ee90-3263-49f1-ad9f-fc8b6580d594 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.258511 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1266/2490] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:44.262697 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6691fc-e359-4906-8099-bd1923961d60 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.273300 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6691fc-e359-4906-8099-bd1923961d60 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.279007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb094-15f9-4cd1-8711-e04e2e1e970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.279661 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb094-15f9-4cd1-8711-e04e2e1e970e admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.279942 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb094-15f9-4cd1-8711-e04e2e1e970e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.280211 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb094-15f9-4cd1-8711-e04e2e1e970e admin admin] PATH_INFO: `/v3/projects/e9acee7f8aa046eaac2f2e4dceb200d0/users/ca276aa4c9374605a67edd055cab7ad7/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.295454 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccb094-15f9-4cd1-8711-e04e2e1e970e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9acee7f8aa046eaac2f2e4dceb200d0, user_id=ca276aa4c9374605a67edd055cab7ad7, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.298080 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccb094-15f9-4cd1-8711-e04e2e1e970e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.312725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1225/2491] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:32:44 2022] PUT /identity/v3/projects/e9acee7f8aa046eaac2f2e4dceb200d0/users/ca276aa4c9374605a67edd055cab7ad7/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:44.316743 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ee90-3263-49f1-ad9f-fc8b6580d594 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.326704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ee90-3263-49f1-ad9f-fc8b6580d594 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.384139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb39e5a-3f56-45b1-bbd7-bd7312265200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.384668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb39e5a-3f56-45b1-bbd7-bd7312265200 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.384942 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb39e5a-3f56-45b1-bbd7-bd7312265200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.385516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb39e5a-3f56-45b1-bbd7-bd7312265200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.386164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb39e5a-3f56-45b1-bbd7-bd7312265200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.387778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb39e5a-3f56-45b1-bbd7-bd7312265200 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.397563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1267/2492] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:44.402130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb094-15f9-4cd1-8711-e04e2e1e970e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.413149 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb094-15f9-4cd1-8711-e04e2e1e970e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.419143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a0072-bc34-4a62-a21b-257f50ccd97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.419809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0072-bc34-4a62-a21b-257f50ccd97c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.420089 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0072-bc34-4a62-a21b-257f50ccd97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.420360 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0072-bc34-4a62-a21b-257f50ccd97c admin admin] PATH_INFO: `/v3/projects/e9acee7f8aa046eaac2f2e4dceb200d0/users/ca276aa4c9374605a67edd055cab7ad7/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.422511 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a0072-bc34-4a62-a21b-257f50ccd97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9acee7f8aa046eaac2f2e4dceb200d0, user_id=ca276aa4c9374605a67edd055cab7ad7, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.425254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a0072-bc34-4a62-a21b-257f50ccd97c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.436264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1226/2493] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:32:44 2022] PUT /identity/v3/projects/e9acee7f8aa046eaac2f2e4dceb200d0/users/ca276aa4c9374605a67edd055cab7ad7/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:45.143178 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e53c55-d8df-4b56-8927-2efb3ef97950 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.144127 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e53c55-d8df-4b56-8927-2efb3ef97950 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.144411 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e53c55-d8df-4b56-8927-2efb3ef97950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.173808 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-18e53c55-d8df-4b56-8927-2efb3ef97950 None None] MFA Rules not processed for user `ca276aa4c9374605a67edd055cab7ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:45.175345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-18e53c55-d8df-4b56-8927-2efb3ef97950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:45.248139 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:45.264265 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1268/2494] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:45.265259 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355fa20-d452-4ca3-96d1-e3368a5d69f8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.265796 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355fa20-d452-4ca3-96d1-e3368a5d69f8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.266087 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355fa20-d452-4ca3-96d1-e3368a5d69f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.287687 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4355fa20-d452-4ca3-96d1-e3368a5d69f8 None None] MFA Rules not processed for user `78996354537d4906bf15a1307b06c84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:45.288348 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4355fa20-d452-4ca3-96d1-e3368a5d69f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:45.351179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1227/2495] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:45.362691 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e53c55-d8df-4b56-8927-2efb3ef97950 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:45.364601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-18e53c55-d8df-4b56-8927-2efb3ef97950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:45.439508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e53c55-d8df-4b56-8927-2efb3ef97950 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:45.446369 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484902b6-ef40-4136-8e7f-3eb4fd7b2902 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:45.447312 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484902b6-ef40-4136-8e7f-3eb4fd7b2902 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.447791 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484902b6-ef40-4136-8e7f-3eb4fd7b2902 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.448081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484902b6-ef40-4136-8e7f-3eb4fd7b2902 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.458163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484902b6-ef40-4136-8e7f-3eb4fd7b2902 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:45.459807 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484902b6-ef40-4136-8e7f-3eb4fd7b2902 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:45.469658 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1269/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:55.344524 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:55.465054 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=35 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:57.276933 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a63a-5c67-4792-ba11-0fbe2be11e52 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.277437 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a63a-5c67-4792-ba11-0fbe2be11e52 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.277542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a63a-5c67-4792-ba11-0fbe2be11e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.298108 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-aef6a63a-5c67-4792-ba11-0fbe2be11e52 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:57.299334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aef6a63a-5c67-4792-ba11-0fbe2be11e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:57.322131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484902b6-ef40-4136-8e7f-3eb4fd7b2902 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:57.323602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-484902b6-ef40-4136-8e7f-3eb4fd7b2902 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:57.359676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1228/2497] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:57.380905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484902b6-ef40-4136-8e7f-3eb4fd7b2902 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.383130 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6a63a-5c67-4792-ba11-0fbe2be11e52 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:57.384799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294c4f4-d4c4-44b7-a951-70e81adc5f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.385414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c4f4-d4c4-44b7-a951-70e81adc5f15 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.385689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c4f4-d4c4-44b7-a951-70e81adc5f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.385958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c4f4-d4c4-44b7-a951-70e81adc5f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.395335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294c4f4-d4c4-44b7-a951-70e81adc5f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.396784 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294c4f4-d4c4-44b7-a951-70e81adc5f15 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.397067 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6a63a-5c67-4792-ba11-0fbe2be11e52 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.402565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b327f-4050-4265-976b-0b8aaeee8415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.403202 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b327f-4050-4265-976b-0b8aaeee8415 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.403480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b327f-4050-4265-976b-0b8aaeee8415 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.403749 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b327f-4050-4265-976b-0b8aaeee8415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.406842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1270/2498] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:57.412233 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b327f-4050-4265-976b-0b8aaeee8415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.413772 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b327f-4050-4265-976b-0b8aaeee8415 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.424106 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1229/2499] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:01.586559 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27663-058b-45ee-8bf7-f0b072139380 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:01.587217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27663-058b-45ee-8bf7-f0b072139380 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:01.587217 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27663-058b-45ee-8bf7-f0b072139380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:01.608461 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cbb27663-058b-45ee-8bf7-f0b072139380 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:01.609757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cbb27663-058b-45ee-8bf7-f0b072139380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:01.619852 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1271/2500] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:01.657015 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b327f-4050-4265-976b-0b8aaeee8415 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:01.669403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b327f-4050-4265-976b-0b8aaeee8415 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:01.675692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b99b5-0072-4d62-bf6d-306d5328a7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:01.676295 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b99b5-0072-4d62-bf6d-306d5328a7e7 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:01.676570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b99b5-0072-4d62-bf6d-306d5328a7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:01.676840 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b99b5-0072-4d62-bf6d-306d5328a7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:01.685386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b99b5-0072-4d62-bf6d-306d5328a7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:01.687003 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b99b5-0072-4d62-bf6d-306d5328a7e7 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:01.698640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1230/2501] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:04.661086 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbdf91-696e-40f1-84e3-0779279f4f0b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:04.661602 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbdf91-696e-40f1-84e3-0779279f4f0b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:04.661706 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbdf91-696e-40f1-84e3-0779279f4f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:04.684268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d6fbdf91-696e-40f1-84e3-0779279f4f0b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:04.685485 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d6fbdf91-696e-40f1-84e3-0779279f4f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:04.694273 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1272/2502] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:04.721094 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b99b5-0072-4d62-bf6d-306d5328a7e7 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:04.722783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ed0b99b5-0072-4d62-bf6d-306d5328a7e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:04.739691 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b99b5-0072-4d62-bf6d-306d5328a7e7 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:04.746919 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f69818-6cc5-48ef-92e5-caaf3a034d05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:04.747521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f69818-6cc5-48ef-92e5-caaf3a034d05 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:04.747806 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f69818-6cc5-48ef-92e5-caaf3a034d05 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:04.748081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f69818-6cc5-48ef-92e5-caaf3a034d05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:04.756532 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f69818-6cc5-48ef-92e5-caaf3a034d05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:04.758116 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f69818-6cc5-48ef-92e5-caaf3a034d05 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:04.768142 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1231/2503] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:07.823516 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f023-b2eb-4719-bfe5-a3313a7ab46b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:07.824065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f023-b2eb-4719-bfe5-a3313a7ab46b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:07.824065 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f023-b2eb-4719-bfe5-a3313a7ab46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:07.844984 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f287f023-b2eb-4719-bfe5-a3313a7ab46b None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:07.846197 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f287f023-b2eb-4719-bfe5-a3313a7ab46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:07.855004 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1273/2504] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:07.913226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f69818-6cc5-48ef-92e5-caaf3a034d05 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:07.930090 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f69818-6cc5-48ef-92e5-caaf3a034d05 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:07.935071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccedaf-26eb-4d17-90df-bad32b08fd1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:07.935676 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccedaf-26eb-4d17-90df-bad32b08fd1f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:07.935956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccedaf-26eb-4d17-90df-bad32b08fd1f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:07.936226 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccedaf-26eb-4d17-90df-bad32b08fd1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:07.945042 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccedaf-26eb-4d17-90df-bad32b08fd1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:07.946621 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccedaf-26eb-4d17-90df-bad32b08fd1f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:07.957166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1232/2505] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:11.030322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06d78c-e955-46c1-ac79-159254d56521 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.031134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06d78c-e955-46c1-ac79-159254d56521 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.031435 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06d78c-e955-46c1-ac79-159254d56521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.055898 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6f06d78c-e955-46c1-ac79-159254d56521 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:11.057539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6f06d78c-e955-46c1-ac79-159254d56521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:11.067663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1274/2506] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Oct 27 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:11.090442 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccedaf-26eb-4d17-90df-bad32b08fd1f service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.102915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccedaf-26eb-4d17-90df-bad32b08fd1f service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.109529 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb390-cd7c-41fe-b2ea-35c0d30ae66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.110161 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb390-cd7c-41fe-b2ea-35c0d30ae66e service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.110440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb390-cd7c-41fe-b2ea-35c0d30ae66e service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.110710 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb390-cd7c-41fe-b2ea-35c0d30ae66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.121391 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cb390-cd7c-41fe-b2ea-35c0d30ae66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.123143 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cb390-cd7c-41fe-b2ea-35c0d30ae66e service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.134435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1233/2507] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:18.799209 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06d78c-e955-46c1-ac79-159254d56521 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:18.809529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06d78c-e955-46c1-ac79-159254d56521 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:18.815900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:18.816933 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:18.817395 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:18.817725 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] PATH_INFO: `/v3/users/78996354537d4906bf15a1307b06c84c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:18.818989 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78996354537d4906bf15a1307b06c84c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:18.821036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:18.870480 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78996354537d4906bf15a1307b06c84c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.880124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78996354537d4906bf15a1307b06c84c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.887590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78996354537d4906bf15a1307b06c84c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.888247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78996354537d4906bf15a1307b06c84c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.900856 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78996354537d4906bf15a1307b06c84c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.906925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1275/2508] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:33:18 2022] DELETE /identity/v3/users/78996354537d4906bf15a1307b06c84c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:19.080072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb390-cd7c-41fe-b2ea-35c0d30ae66e service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:19.094111 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb390-cd7c-41fe-b2ea-35c0d30ae66e service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:19.159898 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:19.160565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.160863 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.161133 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] PATH_INFO: `/v3/projects/2b1e56e7f11a499e8ba0ee8431dc368e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.162353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1e56e7f11a499e8ba0ee8431dc368e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:19.164327 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:19.203980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:19.214750 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1e56e7f11a499e8ba0ee8431dc368e', 'request_id': 'req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.223190 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1e56e7f11a499e8ba0ee8431dc368e', 'request_id': 'req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.229215 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1e56e7f11a499e8ba0ee8431dc368e', 'request_id': 'req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.243823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] The token cache is being invalidate because project 2b1e56e7f11a499e8ba0ee8431dc368e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:19.244113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.244768 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.246262 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1234/2509] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:33:19 2022] DELETE /identity/v3/projects/2b1e56e7f11a499e8ba0ee8431dc368e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:19.255408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:19.255408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:19.265364 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eaf7a-f4da-4032-ab83-b20a2ea7e934 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:19.312102 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:19.331553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:19.332470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.332989 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.333276 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] PATH_INFO: `/v3/users/ca276aa4c9374605a67edd055cab7ad7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.334427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca276aa4c9374605a67edd055cab7ad7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:19.336398 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:19.385908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca276aa4c9374605a67edd055cab7ad7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.394181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca276aa4c9374605a67edd055cab7ad7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.401668 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca276aa4c9374605a67edd055cab7ad7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.402371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca276aa4c9374605a67edd055cab7ad7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.414632 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-49642145-cf35-40bc-a3ca-fc3e41154070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca276aa4c9374605a67edd055cab7ad7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.420764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1276/2510] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:33:19 2022] DELETE /identity/v3/users/ca276aa4c9374605a67edd055cab7ad7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:19.604376 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:19.606131 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:19.620723 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af5fe6-1201-4fa6-b684-7ee07ddfa2b9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:19.681620 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:19.682264 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.682538 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.682834 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] PATH_INFO: `/v3/projects/e9acee7f8aa046eaac2f2e4dceb200d0` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.684047 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9acee7f8aa046eaac2f2e4dceb200d0)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:19.685951 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:19.737993 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9acee7f8aa046eaac2f2e4dceb200d0', 'request_id': 'req-2c84960a-b069-487d-be93-e8b4863160a1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.746123 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9acee7f8aa046eaac2f2e4dceb200d0', 'request_id': 'req-2c84960a-b069-487d-be93-e8b4863160a1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.754640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9acee7f8aa046eaac2f2e4dceb200d0', 'request_id': 'req-2c84960a-b069-487d-be93-e8b4863160a1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.766997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] The token cache is being invalidate because project e9acee7f8aa046eaac2f2e4dceb200d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:19.767287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.768007 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c84960a-b069-487d-be93-e8b4863160a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.769608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1235/2511] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:33:19 2022] DELETE /identity/v3/projects/e9acee7f8aa046eaac2f2e4dceb200d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:19.775831 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88859dc6-0853-4819-bd3e-b3b49fa7034f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.776067 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88859dc6-0853-4819-bd3e-b3b49fa7034f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.776482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88859dc6-0853-4819-bd3e-b3b49fa7034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.800152 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-88859dc6-0853-4819-bd3e-b3b49fa7034f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:19.801355 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-88859dc6-0853-4819-bd3e-b3b49fa7034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:19.863194 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1277/2512] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:19.871371 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3470060-d6ff-41b5-9b0f-fc2d1bf293a4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.871622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3470060-d6ff-41b5-9b0f-fc2d1bf293a4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.871914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3470060-d6ff-41b5-9b0f-fc2d1bf293a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.892148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e3470060-d6ff-41b5-9b0f-fc2d1bf293a4 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:19.893484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e3470060-d6ff-41b5-9b0f-fc2d1bf293a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:19.901990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1236/2513] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:19.906949 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88859dc6-0853-4819-bd3e-b3b49fa7034f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:19.919435 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88859dc6-0853-4819-bd3e-b3b49fa7034f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:19.924577 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80425e-a7d5-4af6-a3c7-ee26990e9a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:19.925181 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80425e-a7d5-4af6-a3c7-ee26990e9a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.925460 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80425e-a7d5-4af6-a3c7-ee26990e9a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.925739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80425e-a7d5-4af6-a3c7-ee26990e9a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.926392 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80425e-a7d5-4af6-a3c7-ee26990e9a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:19.926841 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80425e-a7d5-4af6-a3c7-ee26990e9a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:19.928438 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80425e-a7d5-4af6-a3c7-ee26990e9a88 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:19.940536 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1278/2514] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:19.944903 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3470060-d6ff-41b5-9b0f-fc2d1bf293a4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:19.954318 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3470060-d6ff-41b5-9b0f-fc2d1bf293a4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:19.959888 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07376e50-ab68-4899-8c9f-4eb4b5afd1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:19.960533 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07376e50-ab68-4899-8c9f-4eb4b5afd1dc admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.960807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07376e50-ab68-4899-8c9f-4eb4b5afd1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.961071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07376e50-ab68-4899-8c9f-4eb4b5afd1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.961719 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07376e50-ab68-4899-8c9f-4eb4b5afd1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:19.963753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07376e50-ab68-4899-8c9f-4eb4b5afd1dc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:19.993542 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1237/2515] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:33:19 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:19.997890 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80425e-a7d5-4af6-a3c7-ee26990e9a88 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.007979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80425e-a7d5-4af6-a3c7-ee26990e9a88 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.059912 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:20.067824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8bab5-4c5c-4ad1-94fc-727a38ffc01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.068560 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8bab5-4c5c-4ad1-94fc-727a38ffc01b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.069173 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8bab5-4c5c-4ad1-94fc-727a38ffc01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.069510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8bab5-4c5c-4ad1-94fc-727a38ffc01b admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.070316 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8bab5-4c5c-4ad1-94fc-727a38ffc01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.072726 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8bab5-4c5c-4ad1-94fc-727a38ffc01b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.094689 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1279/2516] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:33:19 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:20.098991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07376e50-ab68-4899-8c9f-4eb4b5afd1dc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.109368 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07376e50-ab68-4899-8c9f-4eb4b5afd1dc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.114771 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e4aa-509e-48c1-b843-48cd1b4a09d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.115365 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e4aa-509e-48c1-b843-48cd1b4a09d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.115637 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e4aa-509e-48c1-b843-48cd1b4a09d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.115886 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e4aa-509e-48c1-b843-48cd1b4a09d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.116526 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9e4aa-509e-48c1-b843-48cd1b4a09d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.118152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9e4aa-509e-48c1-b843-48cd1b4a09d8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.128152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1238/2517] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:20.132029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8bab5-4c5c-4ad1-94fc-727a38ffc01b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.141965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8bab5-4c5c-4ad1-94fc-727a38ffc01b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.147171 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7da037-dc77-4ada-ac4e-ce21fedb6f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.147775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7da037-dc77-4ada-ac4e-ce21fedb6f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.148058 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7da037-dc77-4ada-ac4e-ce21fedb6f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.148332 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7da037-dc77-4ada-ac4e-ce21fedb6f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.148979 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7da037-dc77-4ada-ac4e-ce21fedb6f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.150580 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7da037-dc77-4ada-ac4e-ce21fedb6f9a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.161368 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1280/2518] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:20.165569 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e4aa-509e-48c1-b843-48cd1b4a09d8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.176010 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e4aa-509e-48c1-b843-48cd1b4a09d8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.182314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bd0d5-d0d2-4b06-b83b-0c363b8e80c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.183031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bd0d5-d0d2-4b06-b83b-0c363b8e80c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.183310 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bd0d5-d0d2-4b06-b83b-0c363b8e80c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.183745 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bd0d5-d0d2-4b06-b83b-0c363b8e80c9 admin admin] PATH_INFO: `/v3/projects/59faa8cfa5174d88ba410be765df46f8/users/86314ba254d749aeb85beab5f2001e13/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.197054 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:20.200681 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bd0d5-d0d2-4b06-b83b-0c363b8e80c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59faa8cfa5174d88ba410be765df46f8, user_id=86314ba254d749aeb85beab5f2001e13, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.204650 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bd0d5-d0d2-4b06-b83b-0c363b8e80c9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.220565 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1239/2519] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:33:20 2022] PUT /identity/v3/projects/59faa8cfa5174d88ba410be765df46f8/users/86314ba254d749aeb85beab5f2001e13/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:20.231169 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276f67-7a0e-4d91-bc70-bc1824a1141f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.231458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276f67-7a0e-4d91-bc70-bc1824a1141f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.231751 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276f67-7a0e-4d91-bc70-bc1824a1141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.260177 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-45276f67-7a0e-4d91-bc70-bc1824a1141f None None] MFA Rules not processed for user `86314ba254d749aeb85beab5f2001e13`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:20.261386 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-45276f67-7a0e-4d91-bc70-bc1824a1141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:20.328507 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1281/2520] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:20.340141 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bd0d5-d0d2-4b06-b83b-0c363b8e80c9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.343592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-013bd0d5-d0d2-4b06-b83b-0c363b8e80c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:20.403585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bd0d5-d0d2-4b06-b83b-0c363b8e80c9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.407679 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a3144-20a9-42d0-91bd-9049cb6b33c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.408316 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a3144-20a9-42d0-91bd-9049cb6b33c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.408597 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a3144-20a9-42d0-91bd-9049cb6b33c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.408870 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a3144-20a9-42d0-91bd-9049cb6b33c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.417757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a3144-20a9-42d0-91bd-9049cb6b33c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.419230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a3144-20a9-42d0-91bd-9049cb6b33c7 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.430335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1240/2521] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:23.011814 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276f67-7a0e-4d91-bc70-bc1824a1141f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.079041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276f67-7a0e-4d91-bc70-bc1824a1141f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.083938 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.084582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.084960 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.085266 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] PATH_INFO: `/v3/users/86314ba254d749aeb85beab5f2001e13` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.086414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=86314ba254d749aeb85beab5f2001e13)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.088385 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.137676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86314ba254d749aeb85beab5f2001e13'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.144764 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86314ba254d749aeb85beab5f2001e13'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.151662 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86314ba254d749aeb85beab5f2001e13'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.152287 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86314ba254d749aeb85beab5f2001e13'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.154133 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:23.165736 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86314ba254d749aeb85beab5f2001e13'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.171585 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1282/2522] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:33:23 2022] DELETE /identity/v3/users/86314ba254d749aeb85beab5f2001e13 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:23.176326 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcb39-96b9-4840-a7dd-fbbd105939e8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.176809 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcb39-96b9-4840-a7dd-fbbd105939e8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.176905 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcb39-96b9-4840-a7dd-fbbd105939e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.197152 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-310bcb39-96b9-4840-a7dd-fbbd105939e8 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:23.198366 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-310bcb39-96b9-4840-a7dd-fbbd105939e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:23.261355 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1241/2523] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:23.271721 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.273387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:23.339931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9727e-0e1b-47d8-aa65-cc3e02a5ebbb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.346039 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6fdad-6982-41fc-a26a-be0f54964623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.347003 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6fdad-6982-41fc-a26a-be0f54964623 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.347365 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6fdad-6982-41fc-a26a-be0f54964623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.347710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6fdad-6982-41fc-a26a-be0f54964623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.358418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6fdad-6982-41fc-a26a-be0f54964623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.359876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6fdad-6982-41fc-a26a-be0f54964623 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.370002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1283/2524] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:23.645709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcb39-96b9-4840-a7dd-fbbd105939e8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.647230 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-310bcb39-96b9-4840-a7dd-fbbd105939e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:23.659917 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcb39-96b9-4840-a7dd-fbbd105939e8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.667291 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.667938 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.668219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.668488 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] PATH_INFO: `/v3/projects/59faa8cfa5174d88ba410be765df46f8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.671214 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59faa8cfa5174d88ba410be765df46f8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.673349 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.722816 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59faa8cfa5174d88ba410be765df46f8', 'request_id': 'req-d0eda4b7-8a8f-46ec-9789-273f18b5438c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.730478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59faa8cfa5174d88ba410be765df46f8', 'request_id': 'req-d0eda4b7-8a8f-46ec-9789-273f18b5438c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.736309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59faa8cfa5174d88ba410be765df46f8', 'request_id': 'req-d0eda4b7-8a8f-46ec-9789-273f18b5438c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.748722 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] The token cache is being invalidate because project 59faa8cfa5174d88ba410be765df46f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:23.749046 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.749812 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d0eda4b7-8a8f-46ec-9789-273f18b5438c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.751481 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1242/2525] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:33:23 2022] DELETE /identity/v3/projects/59faa8cfa5174d88ba410be765df46f8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:23.756583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433911-e862-47fb-b524-adfa971b79d8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.756850 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433911-e862-47fb-b524-adfa971b79d8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.757148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433911-e862-47fb-b524-adfa971b79d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.778900 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-00433911-e862-47fb-b524-adfa971b79d8 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:23.780113 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-00433911-e862-47fb-b524-adfa971b79d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:23.844482 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1284/2526] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:23.852657 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2546430-505e-46fe-b070-e4d608ebff1d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.853148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2546430-505e-46fe-b070-e4d608ebff1d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.853480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2546430-505e-46fe-b070-e4d608ebff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.874573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c2546430-505e-46fe-b070-e4d608ebff1d None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:23.875797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c2546430-505e-46fe-b070-e4d608ebff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:23.884459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1243/2527] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:23.888867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433911-e862-47fb-b524-adfa971b79d8 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.899358 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433911-e862-47fb-b524-adfa971b79d8 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.905262 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234090-79dd-4ab8-b7cf-00d2a2ca2735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.905873 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234090-79dd-4ab8-b7cf-00d2a2ca2735 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.906153 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234090-79dd-4ab8-b7cf-00d2a2ca2735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.906426 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234090-79dd-4ab8-b7cf-00d2a2ca2735 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.907112 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee234090-79dd-4ab8-b7cf-00d2a2ca2735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:23.907417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee234090-79dd-4ab8-b7cf-00d2a2ca2735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.909020 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee234090-79dd-4ab8-b7cf-00d2a2ca2735 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.921522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1285/2528] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:23.925929 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2546430-505e-46fe-b070-e4d608ebff1d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.937332 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2546430-505e-46fe-b070-e4d608ebff1d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.942532 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9205-c668-4fe2-a32d-4d311943e8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.943185 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9205-c668-4fe2-a32d-4d311943e8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.943455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9205-c668-4fe2-a32d-4d311943e8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.943729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9205-c668-4fe2-a32d-4d311943e8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.944698 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b9205-c668-4fe2-a32d-4d311943e8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.946475 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b9205-c668-4fe2-a32d-4d311943e8e3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.956495 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:23.977521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1244/2529] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:33:23 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:23.981617 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234090-79dd-4ab8-b7cf-00d2a2ca2735 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.992140 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234090-79dd-4ab8-b7cf-00d2a2ca2735 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:24.052450 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ff6a-0d77-4d2b-b744-09987b933326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:24.053268 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ff6a-0d77-4d2b-b744-09987b933326 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:24.053563 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ff6a-0d77-4d2b-b744-09987b933326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:24.053843 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ff6a-0d77-4d2b-b744-09987b933326 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:24.054528 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ff6a-0d77-4d2b-b744-09987b933326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:24.056827 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ff6a-0d77-4d2b-b744-09987b933326 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:24.078899 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1286/2530] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:33:23 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:24.083062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9205-c668-4fe2-a32d-4d311943e8e3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:24.093599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9205-c668-4fe2-a32d-4d311943e8e3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:24.099931 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9856c-16c2-4f59-83e9-c287c2fb7034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:24.100635 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9856c-16c2-4f59-83e9-c287c2fb7034 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:24.100914 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9856c-16c2-4f59-83e9-c287c2fb7034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:24.101266 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9856c-16c2-4f59-83e9-c287c2fb7034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:24.101899 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9856c-16c2-4f59-83e9-c287c2fb7034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:24.103724 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9856c-16c2-4f59-83e9-c287c2fb7034 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:24.130011 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1245/2531] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:24.134366 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ff6a-0d77-4d2b-b744-09987b933326 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:24.139888 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:24.148056 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ff6a-0d77-4d2b-b744-09987b933326 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:24.153946 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489089c-24de-496e-8572-086f53dbe5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:24.154576 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489089c-24de-496e-8572-086f53dbe5ea admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:24.154902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489089c-24de-496e-8572-086f53dbe5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:24.155380 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489089c-24de-496e-8572-086f53dbe5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:24.156143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489089c-24de-496e-8572-086f53dbe5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:24.157749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489089c-24de-496e-8572-086f53dbe5ea admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:24.169258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1287/2532] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:24.174006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9856c-16c2-4f59-83e9-c287c2fb7034 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:24.184521 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9856c-16c2-4f59-83e9-c287c2fb7034 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:24.189182 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ecbd4-1083-4b3a-ad67-1f33359c147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:24.189786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ecbd4-1083-4b3a-ad67-1f33359c147c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:24.190071 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ecbd4-1083-4b3a-ad67-1f33359c147c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:24.190350 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ecbd4-1083-4b3a-ad67-1f33359c147c admin admin] PATH_INFO: `/v3/projects/9079f856344646c493e85803d83c29b8/users/c1808a3877544e428d7c466653bfbf5e/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:24.206314 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ecbd4-1083-4b3a-ad67-1f33359c147c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9079f856344646c493e85803d83c29b8, user_id=c1808a3877544e428d7c466653bfbf5e, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:24.208980 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ecbd4-1083-4b3a-ad67-1f33359c147c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:24.223711 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1246/2533] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:33:24 2022] PUT /identity/v3/projects/9079f856344646c493e85803d83c29b8/users/c1808a3877544e428d7c466653bfbf5e/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:24.234625 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d136c63-9db9-4d96-adb2-233d658b5c8d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:24.234965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d136c63-9db9-4d96-adb2-233d658b5c8d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:24.235247 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d136c63-9db9-4d96-adb2-233d658b5c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:24.263882 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8d136c63-9db9-4d96-adb2-233d658b5c8d None None] MFA Rules not processed for user `c1808a3877544e428d7c466653bfbf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:24.265105 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8d136c63-9db9-4d96-adb2-233d658b5c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:24.334956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1288/2534] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:24.346407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ecbd4-1083-4b3a-ad67-1f33359c147c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:24.348287 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-291ecbd4-1083-4b3a-ad67-1f33359c147c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:24.407759 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ecbd4-1083-4b3a-ad67-1f33359c147c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:24.411852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab1862-63f2-4822-bdb3-50effb52d3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095bc16a66c24f44939009ac95e2bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:24.412464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab1862-63f2-4822-bdb3-50effb52d3af service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:24.412765 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab1862-63f2-4822-bdb3-50effb52d3af service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:24.413036 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab1862-63f2-4822-bdb3-50effb52d3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:24.421763 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab1862-63f2-4822-bdb3-50effb52d3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:24.423219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab1862-63f2-4822-bdb3-50effb52d3af service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:24.432333 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1247/2535] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:25.812749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911ac5c-27b7-4cbb-bded-33dd84e3c4e8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:25.813345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911ac5c-27b7-4cbb-bded-33dd84e3c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:25.813345 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911ac5c-27b7-4cbb-bded-33dd84e3c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:25.838038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a911ac5c-27b7-4cbb-bded-33dd84e3c4e8 None None] MFA Rules not processed for user `c1808a3877544e428d7c466653bfbf5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:25.839290 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a911ac5c-27b7-4cbb-bded-33dd84e3c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:25.847700 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1289/2536] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:34.428397 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:35.832119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=39 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:39.930660 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc9ad-af02-421a-94f0-16937970a9cf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.931107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc9ad-af02-421a-94f0-16937970a9cf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.931390 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc9ad-af02-421a-94f0-16937970a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.961753 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b1dbc9ad-af02-421a-94f0-16937970a9cf None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:39.963019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b1dbc9ad-af02-421a-94f0-16937970a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:40.021941 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1248/2537] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:40.068967 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911ac5c-27b7-4cbb-bded-33dd84e3c4e8 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:40.070441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a911ac5c-27b7-4cbb-bded-33dd84e3c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:40.141875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911ac5c-27b7-4cbb-bded-33dd84e3c4e8 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:40.148198 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc71184-4053-484b-85c2-5c5c4e8787e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:40.148835 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc71184-4053-484b-85c2-5c5c4e8787e5 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:40.149111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc71184-4053-484b-85c2-5c5c4e8787e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:40.149382 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc71184-4053-484b-85c2-5c5c4e8787e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:40.158500 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc71184-4053-484b-85c2-5c5c4e8787e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:40.160168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc71184-4053-484b-85c2-5c5c4e8787e5 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:40.168690 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1290/2538] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:33:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:40.444818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbc9ad-af02-421a-94f0-16937970a9cf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:40.446503 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b1dbc9ad-af02-421a-94f0-16937970a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:40.518795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbc9ad-af02-421a-94f0-16937970a9cf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:40.523288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:40.523955 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:40.524229 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:40.524504 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] PATH_INFO: `/v3/users/9208660dd7504213a1eee4e72abad956` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:40.525655 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9208660dd7504213a1eee4e72abad956)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:40.527693 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:40.575055 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9208660dd7504213a1eee4e72abad956'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.584085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9208660dd7504213a1eee4e72abad956'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.597860 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9208660dd7504213a1eee4e72abad956'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.605280 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9208660dd7504213a1eee4e72abad956'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.606041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9208660dd7504213a1eee4e72abad956'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.612804 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1249/2539] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:33:40 2022] DELETE /identity/v3/users/9208660dd7504213a1eee4e72abad956 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:40.692399 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70e93-3528-4a2b-a5b8-2d6ba655fbda None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:40.692720 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70e93-3528-4a2b-a5b8-2d6ba655fbda None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:40.693001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70e93-3528-4a2b-a5b8-2d6ba655fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:40.712501 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c5c70e93-3528-4a2b-a5b8-2d6ba655fbda None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:40.713724 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c5c70e93-3528-4a2b-a5b8-2d6ba655fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:40.775384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1291/2540] 10.222.0.23 () {58 vars in 967 bytes} [Thu Oct 27 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:40.787033 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:40.788592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:40.794471 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70e93-3528-4a2b-a5b8-2d6ba655fbda None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:40.795925 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c5c70e93-3528-4a2b-a5b8-2d6ba655fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:40.809990 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:40.866862 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dcfe3-5f98-4277-9b89-ca9208bca6de admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:40.871608 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:40.872244 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:40.872517 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:40.872786 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] PATH_INFO: `/v3/projects/925c3f76d23844218547d771b3b772cc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:40.874072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925c3f76d23844218547d771b3b772cc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:40.876006 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:40.876728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70e93-3528-4a2b-a5b8-2d6ba655fbda None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:40.881896 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dddeda-a653-4d9a-8f90-88699ba092aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:40.882582 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dddeda-a653-4d9a-8f90-88699ba092aa service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:40.882958 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dddeda-a653-4d9a-8f90-88699ba092aa service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:40.883296 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dddeda-a653-4d9a-8f90-88699ba092aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:40.891521 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dddeda-a653-4d9a-8f90-88699ba092aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:40.893129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dddeda-a653-4d9a-8f90-88699ba092aa service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:40.901091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1292/2541] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:33:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:40.925274 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925c3f76d23844218547d771b3b772cc', 'request_id': 'req-1d8251eb-e51c-44cc-b7bc-859aaa25d500'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.933072 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925c3f76d23844218547d771b3b772cc', 'request_id': 'req-1d8251eb-e51c-44cc-b7bc-859aaa25d500'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.941496 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925c3f76d23844218547d771b3b772cc', 'request_id': 'req-1d8251eb-e51c-44cc-b7bc-859aaa25d500'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.953167 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] The token cache is being invalidate because project 925c3f76d23844218547d771b3b772cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:40.953454 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.954102 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1d8251eb-e51c-44cc-b7bc-859aaa25d500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:40.955632 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1250/2542] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:33:40 2022] DELETE /identity/v3/projects/925c3f76d23844218547d771b3b772cc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:40.961388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b56ee-c1c7-4565-b9c7-7f370d9bbab6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:40.961992 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b56ee-c1c7-4565-b9c7-7f370d9bbab6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:40.962270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b56ee-c1c7-4565-b9c7-7f370d9bbab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:40.982710 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fa6b56ee-c1c7-4565-b9c7-7f370d9bbab6 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:40.983952 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fa6b56ee-c1c7-4565-b9c7-7f370d9bbab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:41.005508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:41.046011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1293/2543] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:41.054484 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07c3d8-6183-4d31-94eb-235b6830fef8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.055036 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07c3d8-6183-4d31-94eb-235b6830fef8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.055309 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07c3d8-6183-4d31-94eb-235b6830fef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.085080 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3b07c3d8-6183-4d31-94eb-235b6830fef8 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:41.086286 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3b07c3d8-6183-4d31-94eb-235b6830fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:41.095186 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1251/2544] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:41.099574 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b56ee-c1c7-4565-b9c7-7f370d9bbab6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.109600 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b56ee-c1c7-4565-b9c7-7f370d9bbab6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.115213 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a3a5d-0ad9-4bad-9404-54318225255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.115905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a3a5d-0ad9-4bad-9404-54318225255a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.116236 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a3a5d-0ad9-4bad-9404-54318225255a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.116590 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a3a5d-0ad9-4bad-9404-54318225255a admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.117322 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a3a5d-0ad9-4bad-9404-54318225255a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:41.117694 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a3a5d-0ad9-4bad-9404-54318225255a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.119417 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a3a5d-0ad9-4bad-9404-54318225255a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:41.131803 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1294/2545] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:41.134212 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0def7-8cf6-4d66-94c7-d0be7b88c5a1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.134499 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0def7-8cf6-4d66-94c7-d0be7b88c5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.134803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0def7-8cf6-4d66-94c7-d0be7b88c5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.136131 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a3a5d-0ad9-4bad-9404-54318225255a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.146072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a3a5d-0ad9-4bad-9404-54318225255a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.150921 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87926e-de3b-49bc-9d94-470359cde54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.151583 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87926e-de3b-49bc-9d94-470359cde54d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.151862 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87926e-de3b-49bc-9d94-470359cde54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.152135 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87926e-de3b-49bc-9d94-470359cde54d admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.152802 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87926e-de3b-49bc-9d94-470359cde54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.154417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0fe0def7-8cf6-4d66-94c7-d0be7b88c5a1 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:41.154771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87926e-de3b-49bc-9d94-470359cde54d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:41.155654 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0fe0def7-8cf6-4d66-94c7-d0be7b88c5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:41.185150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1295/2546] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:33:41 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:41.189218 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87926e-de3b-49bc-9d94-470359cde54d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.211729 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1252/2547] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:41.223930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0def7-8cf6-4d66-94c7-d0be7b88c5a1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.225388 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0fe0def7-8cf6-4d66-94c7-d0be7b88c5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:41.250314 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87926e-de3b-49bc-9d94-470359cde54d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.255408 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369505-0861-4cd0-82c9-44c43ed8998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.255999 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369505-0861-4cd0-82c9-44c43ed8998d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.256361 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369505-0861-4cd0-82c9-44c43ed8998d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.256610 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369505-0861-4cd0-82c9-44c43ed8998d admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.257224 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8369505-0861-4cd0-82c9-44c43ed8998d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.259124 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8369505-0861-4cd0-82c9-44c43ed8998d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:41.274173 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:41.283975 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1296/2548] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:33:41 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:41.284916 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369505-0861-4cd0-82c9-44c43ed8998d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.294414 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369505-0861-4cd0-82c9-44c43ed8998d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.299530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccda75-6f4a-4cb1-b821-9b37fc783712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.300191 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccda75-6f4a-4cb1-b821-9b37fc783712 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.300465 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccda75-6f4a-4cb1-b821-9b37fc783712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.300675 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0def7-8cf6-4d66-94c7-d0be7b88c5a1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.300885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccda75-6f4a-4cb1-b821-9b37fc783712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.301397 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccda75-6f4a-4cb1-b821-9b37fc783712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.303129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccda75-6f4a-4cb1-b821-9b37fc783712 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:41.314805 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1297/2549] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:41.317601 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccda75-6f4a-4cb1-b821-9b37fc783712 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.327636 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccda75-6f4a-4cb1-b821-9b37fc783712 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.332449 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f19d09-1779-4aed-86a8-f1f7f9a5224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.333040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19d09-1779-4aed-86a8-f1f7f9a5224b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.333318 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19d09-1779-4aed-86a8-f1f7f9a5224b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.333591 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f19d09-1779-4aed-86a8-f1f7f9a5224b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.334258 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f19d09-1779-4aed-86a8-f1f7f9a5224b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.335854 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f19d09-1779-4aed-86a8-f1f7f9a5224b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:41.346527 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1298/2550] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:41.350569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f19d09-1779-4aed-86a8-f1f7f9a5224b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.360733 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f19d09-1779-4aed-86a8-f1f7f9a5224b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.363386 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f1ba-6cad-4474-b1c1-f81ca4ce2617 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.364074 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f1ba-6cad-4474-b1c1-f81ca4ce2617 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.364423 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f1ba-6cad-4474-b1c1-f81ca4ce2617 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.364762 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f1ba-6cad-4474-b1c1-f81ca4ce2617 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.366068 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4069-2cb5-4e58-97b4-c124f6c69705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.366711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4069-2cb5-4e58-97b4-c124f6c69705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.367019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4069-2cb5-4e58-97b4-c124f6c69705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.367297 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4069-2cb5-4e58-97b4-c124f6c69705 admin admin] PATH_INFO: `/v3/projects/b02b0149e52a4a73b78948580cec2b5c/users/2444386e6ec440de9726d4c9ca701ede/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.382428 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4069-2cb5-4e58-97b4-c124f6c69705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02b0149e52a4a73b78948580cec2b5c, user_id=2444386e6ec440de9726d4c9ca701ede, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.385095 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4069-2cb5-4e58-97b4-c124f6c69705 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:41.398858 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1299/2551] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:33:41 2022] PUT /identity/v3/projects/b02b0149e52a4a73b78948580cec2b5c/users/2444386e6ec440de9726d4c9ca701ede/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:41.404479 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0560b1-dc78-4078-a4dd-b3c9a27aad57 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.404786 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0560b1-dc78-4078-a4dd-b3c9a27aad57 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.405064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0560b1-dc78-4078-a4dd-b3c9a27aad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.421844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700f1ba-6cad-4474-b1c1-f81ca4ce2617 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.423464 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700f1ba-6cad-4474-b1c1-f81ca4ce2617 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:41.423891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8e0560b1-dc78-4078-a4dd-b3c9a27aad57 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:41.425091 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8e0560b1-dc78-4078-a4dd-b3c9a27aad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:41.431667 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1253/2552] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:33:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:41.459027 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:41.496187 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1300/2553] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:41.506025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f1ba-6cad-4474-b1c1-f81ca4ce2617 service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.507552 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7700f1ba-6cad-4474-b1c1-f81ca4ce2617 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:41.565454 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f1ba-6cad-4474-b1c1-f81ca4ce2617 service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.607469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:41.618673 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06f9e8-736e-486c-a1d7-e2f654db1864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.619788 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06f9e8-736e-486c-a1d7-e2f654db1864 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.620032 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06f9e8-736e-486c-a1d7-e2f654db1864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.620380 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06f9e8-736e-486c-a1d7-e2f654db1864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.630970 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06f9e8-736e-486c-a1d7-e2f654db1864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.632418 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06f9e8-736e-486c-a1d7-e2f654db1864 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:41.643008 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1254/2554] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:33:41.766456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487cab-c06a-4092-903f-b54c4c2d002f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.766766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487cab-c06a-4092-903f-b54c4c2d002f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.767045 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487cab-c06a-4092-903f-b54c4c2d002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.786497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-63487cab-c06a-4092-903f-b54c4c2d002f None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:41.787756 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-63487cab-c06a-4092-903f-b54c4c2d002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:41.855244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1301/2555] 10.222.0.23 () {58 vars in 967 bytes} [Thu Oct 27 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:41.867997 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06f9e8-736e-486c-a1d7-e2f654db1864 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.947324 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06f9e8-736e-486c-a1d7-e2f654db1864 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.953818 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c94a0-9857-495b-8f4b-78d68af11d05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.954455 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c94a0-9857-495b-8f4b-78d68af11d05 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.954757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c94a0-9857-495b-8f4b-78d68af11d05 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.955039 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c94a0-9857-495b-8f4b-78d68af11d05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.964308 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c94a0-9857-495b-8f4b-78d68af11d05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.965896 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c94a0-9857-495b-8f4b-78d68af11d05 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:41.974694 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1255/2556] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:33:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 01:33:44.225388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63487cab-c06a-4092-903f-b54c4c2d002f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:44.228836 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-63487cab-c06a-4092-903f-b54c4c2d002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.247224 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63487cab-c06a-4092-903f-b54c4c2d002f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:44.252360 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:44.253088 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.253433 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.253768 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] PATH_INFO: `/v3/users/c1808a3877544e428d7c466653bfbf5e` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.255016 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1808a3877544e428d7c466653bfbf5e)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:44.257115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:44.326148 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1808a3877544e428d7c466653bfbf5e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.339107 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1808a3877544e428d7c466653bfbf5e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.351510 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1808a3877544e428d7c466653bfbf5e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.352542 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1808a3877544e428d7c466653bfbf5e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.369381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1808a3877544e428d7c466653bfbf5e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.385121 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1302/2557] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:33:44 2022] DELETE /identity/v3/users/c1808a3877544e428d7c466653bfbf5e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:44.392104 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6813a-d1a1-4fbd-8bb1-5d022195963f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.392652 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6813a-d1a1-4fbd-8bb1-5d022195963f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.392748 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6813a-d1a1-4fbd-8bb1-5d022195963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.416742 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-09b6813a-d1a1-4fbd-8bb1-5d022195963f None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:44.418148 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-09b6813a-d1a1-4fbd-8bb1-5d022195963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.494013 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1256/2558] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:44.500719 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:44.502278 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.573168 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54045656-f8fa-46c6-9f31-5c03366dc71e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:44.578055 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a30f1-74ab-4d40-ada0-ab5d9444782c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:44.579049 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a30f1-74ab-4d40-ada0-ab5d9444782c service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.579427 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a30f1-74ab-4d40-ada0-ab5d9444782c service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.579795 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a30f1-74ab-4d40-ada0-ab5d9444782c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.586903 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:44.591932 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a30f1-74ab-4d40-ada0-ab5d9444782c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:44.595782 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a30f1-74ab-4d40-ada0-ab5d9444782c service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:44.610699 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1303/2559] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:44.856107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6813a-d1a1-4fbd-8bb1-5d022195963f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:44.856107 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-09b6813a-d1a1-4fbd-8bb1-5d022195963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.884784 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6813a-d1a1-4fbd-8bb1-5d022195963f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:44.892704 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:44.893953 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.894325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.894689 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] PATH_INFO: `/v3/projects/9079f856344646c493e85803d83c29b8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.896204 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9079f856344646c493e85803d83c29b8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:44.899740 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:44.961387 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9079f856344646c493e85803d83c29b8', 'request_id': 'req-993020fb-a867-42c2-9c2f-a160b3886a56'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.971417 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9079f856344646c493e85803d83c29b8', 'request_id': 'req-993020fb-a867-42c2-9c2f-a160b3886a56'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.978775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9079f856344646c493e85803d83c29b8', 'request_id': 'req-993020fb-a867-42c2-9c2f-a160b3886a56'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.988777 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:44.993915 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] The token cache is being invalidate because project 9079f856344646c493e85803d83c29b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:44.995275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.995275 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-993020fb-a867-42c2-9c2f-a160b3886a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.001085 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1257/2560] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:33:44 2022] DELETE /identity/v3/projects/9079f856344646c493e85803d83c29b8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:45.002885 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf003ae-f158-44f0-8085-d79fc04c426e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.003299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf003ae-f158-44f0-8085-d79fc04c426e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.003638 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf003ae-f158-44f0-8085-d79fc04c426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.024907 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1bf003ae-f158-44f0-8085-d79fc04c426e None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:45.026221 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1bf003ae-f158-44f0-8085-d79fc04c426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.091811 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1304/2561] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:45.100447 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ca2b0-c7b4-4ffe-b9da-74aae8828a72 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.100815 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ca2b0-c7b4-4ffe-b9da-74aae8828a72 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.101025 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ca2b0-c7b4-4ffe-b9da-74aae8828a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.123163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f41ca2b0-c7b4-4ffe-b9da-74aae8828a72 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:45.124019 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f41ca2b0-c7b4-4ffe-b9da-74aae8828a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.133207 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1258/2562] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:45.137396 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf003ae-f158-44f0-8085-d79fc04c426e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.148038 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf003ae-f158-44f0-8085-d79fc04c426e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.156522 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96bc1-2dae-4df7-9337-352aaaf89542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.157165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96bc1-2dae-4df7-9337-352aaaf89542 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.157497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96bc1-2dae-4df7-9337-352aaaf89542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.157773 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96bc1-2dae-4df7-9337-352aaaf89542 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.158437 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96bc1-2dae-4df7-9337-352aaaf89542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:45.158772 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96bc1-2dae-4df7-9337-352aaaf89542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.160452 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96bc1-2dae-4df7-9337-352aaaf89542 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.173551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1305/2563] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Oct 27 01:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:45.177857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ca2b0-c7b4-4ffe-b9da-74aae8828a72 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.188808 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ca2b0-c7b4-4ffe-b9da-74aae8828a72 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.193766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0c7d-fd1e-4499-a709-3334e5ee1ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.194571 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0c7d-fd1e-4499-a709-3334e5ee1ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.194985 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0c7d-fd1e-4499-a709-3334e5ee1ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.195440 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b0c7d-fd1e-4499-a709-3334e5ee1ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.196836 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b0c7d-fd1e-4499-a709-3334e5ee1ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.198227 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b0c7d-fd1e-4499-a709-3334e5ee1ee7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.242966 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1259/2564] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:33:45 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:45.245251 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96bc1-2dae-4df7-9337-352aaaf89542 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.266137 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96bc1-2dae-4df7-9337-352aaaf89542 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.351149 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5098f-5a20-41a8-af42-f22c82ef495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.351586 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5098f-5a20-41a8-af42-f22c82ef495c admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.351801 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5098f-5a20-41a8-af42-f22c82ef495c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.352066 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5098f-5a20-41a8-af42-f22c82ef495c admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.353499 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5098f-5a20-41a8-af42-f22c82ef495c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.355530 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5098f-5a20-41a8-af42-f22c82ef495c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.382711 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1306/2565] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:33:45 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:45.386728 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0c7d-fd1e-4499-a709-3334e5ee1ee7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.397958 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b0c7d-fd1e-4499-a709-3334e5ee1ee7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.406444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e4dd2-d08b-4d09-bc50-8bd1527241ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.407121 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4dd2-d08b-4d09-bc50-8bd1527241ce admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.407409 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4dd2-d08b-4d09-bc50-8bd1527241ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.407709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4dd2-d08b-4d09-bc50-8bd1527241ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.408554 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e4dd2-d08b-4d09-bc50-8bd1527241ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.410171 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e4dd2-d08b-4d09-bc50-8bd1527241ce admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.430946 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1260/2566] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:45.432302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5098f-5a20-41a8-af42-f22c82ef495c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.443441 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5098f-5a20-41a8-af42-f22c82ef495c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.450667 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94179061-83c1-4c87-8192-63923b85603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.451773 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179061-83c1-4c87-8192-63923b85603a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.452243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179061-83c1-4c87-8192-63923b85603a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.452861 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179061-83c1-4c87-8192-63923b85603a admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.453875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94179061-83c1-4c87-8192-63923b85603a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.455892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94179061-83c1-4c87-8192-63923b85603a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.473824 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1307/2567] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:45.478026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e4dd2-d08b-4d09-bc50-8bd1527241ce admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.490573 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e4dd2-d08b-4d09-bc50-8bd1527241ce admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.495692 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55777dfd-1aa3-4d41-b834-9f60a4433edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.496378 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55777dfd-1aa3-4d41-b834-9f60a4433edf admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.496844 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55777dfd-1aa3-4d41-b834-9f60a4433edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.497282 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55777dfd-1aa3-4d41-b834-9f60a4433edf admin admin] PATH_INFO: `/v3/projects/5db279ef988247ac8144d8ea3a348295/users/16e3d70276ec41868fc9f6a2643ee6ae/roles/9145b5c6668a409d854e7d0c4491d775` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.511270 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb81dd0-c07b-43dd-8717-461f71995bba None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.512041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb81dd0-c07b-43dd-8717-461f71995bba None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.512041 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb81dd0-c07b-43dd-8717-461f71995bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.551629 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55777dfd-1aa3-4d41-b834-9f60a4433edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db279ef988247ac8144d8ea3a348295, user_id=16e3d70276ec41868fc9f6a2643ee6ae, role_id=9145b5c6668a409d854e7d0c4491d775)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.554506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55777dfd-1aa3-4d41-b834-9f60a4433edf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.567889 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-bfb81dd0-c07b-43dd-8717-461f71995bba None None] MFA Rules not processed for user `2444386e6ec440de9726d4c9ca701ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:45.569983 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bfb81dd0-c07b-43dd-8717-461f71995bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.582817 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1261/2568] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:33:45 2022] PUT /identity/v3/projects/5db279ef988247ac8144d8ea3a348295/users/16e3d70276ec41868fc9f6a2643ee6ae/roles/9145b5c6668a409d854e7d0c4491d775 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:45.585263 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e915817-28ea-498b-91d1-12da63ae8564 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.585556 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e915817-28ea-498b-91d1-12da63ae8564 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.585839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e915817-28ea-498b-91d1-12da63ae8564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.606857 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1e915817-28ea-498b-91d1-12da63ae8564 None None] MFA Rules not processed for user `b819844d641b4956ae9399e9c171524d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:45.608086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1e915817-28ea-498b-91d1-12da63ae8564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.626828 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:45.649991 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1308/2569] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:45.654569 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb81dd0-c07b-43dd-8717-461f71995bba None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.656031 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bfb81dd0-c07b-43dd-8717-461f71995bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.680826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1262/2570] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:45.691824 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e915817-28ea-498b-91d1-12da63ae8564 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.693623 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1e915817-28ea-498b-91d1-12da63ae8564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.729681 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb81dd0-c07b-43dd-8717-461f71995bba None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.738871 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aee6f-6f61-45d2-b1da-49becd5b8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.739761 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aee6f-6f61-45d2-b1da-49becd5b8cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.740230 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aee6f-6f61-45d2-b1da-49becd5b8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.740504 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aee6f-6f61-45d2-b1da-49becd5b8cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.741163 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aee6f-6f61-45d2-b1da-49becd5b8cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.743162 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aee6f-6f61-45d2-b1da-49becd5b8cdb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.754541 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e915817-28ea-498b-91d1-12da63ae8564 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.758606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f7e9b-6298-4263-83e7-67f053d2861d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.759616 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f7e9b-6298-4263-83e7-67f053d2861d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.759996 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f7e9b-6298-4263-83e7-67f053d2861d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.760683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f7e9b-6298-4263-83e7-67f053d2861d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.774870 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1309/2571] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:33:45 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:45.776403 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f7e9b-6298-4263-83e7-67f053d2861d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.777551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aee6f-6f61-45d2-b1da-49becd5b8cdb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.777869 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f7e9b-6298-4263-83e7-67f053d2861d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.789746 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1263/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:33:45.851906 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aee6f-6f61-45d2-b1da-49becd5b8cdb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.857935 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472341-d51e-4ec8-893c-ff05db32eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.858584 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472341-d51e-4ec8-893c-ff05db32eb96 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.858955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472341-d51e-4ec8-893c-ff05db32eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.859293 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472341-d51e-4ec8-893c-ff05db32eb96 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.860012 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472341-d51e-4ec8-893c-ff05db32eb96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.862082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472341-d51e-4ec8-893c-ff05db32eb96 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.887821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1310/2573] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:33:45 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:45.892240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f7e9b-6298-4263-83e7-67f053d2861d service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.903093 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f7e9b-6298-4263-83e7-67f053d2861d service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.911663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4548dc-3ef9-4e09-ae5a-d70a625af14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.912435 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4548dc-3ef9-4e09-ae5a-d70a625af14d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.912721 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4548dc-3ef9-4e09-ae5a-d70a625af14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.913001 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4548dc-3ef9-4e09-ae5a-d70a625af14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.913826 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4548dc-3ef9-4e09-ae5a-d70a625af14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.915789 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4548dc-3ef9-4e09-ae5a-d70a625af14d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.928683 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1264/2574] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:45.933463 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472341-d51e-4ec8-893c-ff05db32eb96 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.944029 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472341-d51e-4ec8-893c-ff05db32eb96 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.950611 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18736-4e0c-4887-a934-e2cc5864a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.951513 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18736-4e0c-4887-a934-e2cc5864a932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.951799 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18736-4e0c-4887-a934-e2cc5864a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.952078 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18736-4e0c-4887-a934-e2cc5864a932 admin admin] PATH_INFO: `/v3/projects/1f5e58819f7a48abafa07771792332e6/users/5246844d767c445c8fea532787d52d37/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.970129 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a18736-4e0c-4887-a934-e2cc5864a932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5e58819f7a48abafa07771792332e6, user_id=5246844d767c445c8fea532787d52d37, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.972855 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a18736-4e0c-4887-a934-e2cc5864a932 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.990143 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1311/2575] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:33:45 2022] PUT /identity/v3/projects/1f5e58819f7a48abafa07771792332e6/users/5246844d767c445c8fea532787d52d37/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:46.001401 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4548dc-3ef9-4e09-ae5a-d70a625af14d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:46.012785 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4548dc-3ef9-4e09-ae5a-d70a625af14d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:46.032606 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:46.084040 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de17e5a-051a-49c7-bf13-a12b962739b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:46.084757 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de17e5a-051a-49c7-bf13-a12b962739b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:46.085100 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de17e5a-051a-49c7-bf13-a12b962739b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:46.085433 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de17e5a-051a-49c7-bf13-a12b962739b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:46.086163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de17e5a-051a-49c7-bf13-a12b962739b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:46.088075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de17e5a-051a-49c7-bf13-a12b962739b4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:46.100082 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1265/2576] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:46.104567 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18736-4e0c-4887-a934-e2cc5864a932 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:46.121422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18736-4e0c-4887-a934-e2cc5864a932 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:46.126557 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad42fa6-5c90-4840-9066-f3f57cff75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:46.127321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad42fa6-5c90-4840-9066-f3f57cff75a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:46.127605 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad42fa6-5c90-4840-9066-f3f57cff75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:46.127909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad42fa6-5c90-4840-9066-f3f57cff75a6 admin admin] PATH_INFO: `/v3/projects/1f5e58819f7a48abafa07771792332e6/users/5246844d767c445c8fea532787d52d37/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:46.129954 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad42fa6-5c90-4840-9066-f3f57cff75a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5e58819f7a48abafa07771792332e6, user_id=5246844d767c445c8fea532787d52d37, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:46.132704 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad42fa6-5c90-4840-9066-f3f57cff75a6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:46.148904 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1312/2577] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:33:46 2022] PUT /identity/v3/projects/1f5e58819f7a48abafa07771792332e6/users/5246844d767c445c8fea532787d52d37/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:52.357026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d920-c686-4396-b65e-b19f3d367e95 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:52.357026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d920-c686-4396-b65e-b19f3d367e95 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:52.357026 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d920-c686-4396-b65e-b19f3d367e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:52.412272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5b48d920-c686-4396-b65e-b19f3d367e95 None None] MFA Rules not processed for user `16e3d70276ec41868fc9f6a2643ee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:52.413523 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5b48d920-c686-4396-b65e-b19f3d367e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:52.552075 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1266/2578] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:52.553321 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad42fa6-5c90-4840-9066-f3f57cff75a6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:52.601607 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:52.671833 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad42fa6-5c90-4840-9066-f3f57cff75a6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:52.690454 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa8932-3d02-437f-9730-8a0eb400d805 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:52.691000 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa8932-3d02-437f-9730-8a0eb400d805 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:52.691416 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa8932-3d02-437f-9730-8a0eb400d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:52.705269 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d22f8-db30-4395-8b99-2fc22b46a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:52.706136 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d22f8-db30-4395-8b99-2fc22b46a3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:52.706431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d22f8-db30-4395-8b99-2fc22b46a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:52.706757 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d22f8-db30-4395-8b99-2fc22b46a3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:52.707650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d22f8-db30-4395-8b99-2fc22b46a3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:52.709971 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d22f8-db30-4395-8b99-2fc22b46a3dc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:52.727288 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d2aa8932-3d02-437f-9730-8a0eb400d805 None None] MFA Rules not processed for user `5246844d767c445c8fea532787d52d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:52.729113 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2aa8932-3d02-437f-9730-8a0eb400d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:52.757418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1313/2579] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Oct 27 01:33:52 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:52.758335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d22f8-db30-4395-8b99-2fc22b46a3dc admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:52.822240 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1267/2580] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:52.837787 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d22f8-db30-4395-8b99-2fc22b46a3dc admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:52.838334 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa8932-3d02-437f-9730-8a0eb400d805 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:52.841589 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2aa8932-3d02-437f-9730-8a0eb400d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:52.852928 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993965d-e2c9-47dd-b193-71a9384e6f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:52.853529 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993965d-e2c9-47dd-b193-71a9384e6f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:52.854119 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993965d-e2c9-47dd-b193-71a9384e6f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:52.854381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993965d-e2c9-47dd-b193-71a9384e6f71 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:52.855207 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993965d-e2c9-47dd-b193-71a9384e6f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:52.858775 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993965d-e2c9-47dd-b193-71a9384e6f71 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:52.886798 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1314/2581] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Oct 27 01:33:52 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:52.887730 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993965d-e2c9-47dd-b193-71a9384e6f71 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:52.892951 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:52.901754 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993965d-e2c9-47dd-b193-71a9384e6f71 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:52.908565 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec60a0-89e2-4943-b71d-6ec3795253fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:52.909456 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec60a0-89e2-4943-b71d-6ec3795253fe admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:52.909734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec60a0-89e2-4943-b71d-6ec3795253fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:52.910508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec60a0-89e2-4943-b71d-6ec3795253fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:52.910628 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec60a0-89e2-4943-b71d-6ec3795253fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:52.912508 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec60a0-89e2-4943-b71d-6ec3795253fe admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:52.928740 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1315/2582] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:52.932891 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec60a0-89e2-4943-b71d-6ec3795253fe admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:52.940416 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa8932-3d02-437f-9730-8a0eb400d805 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:52.943498 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec60a0-89e2-4943-b71d-6ec3795253fe admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:52.959597 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7fccb-4b21-4761-9dcd-72504068f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:52.960302 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7fccb-4b21-4761-9dcd-72504068f44c admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:52.960596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7fccb-4b21-4761-9dcd-72504068f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:52.960844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7fccb-4b21-4761-9dcd-72504068f44c admin admin] PATH_INFO: `/v3/projects/31d35ff71a6e462d96801e20c7b9f606/users/fad43a65b2364e1d8780cf655b769aee/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:52.985872 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7fccb-4b21-4761-9dcd-72504068f44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d35ff71a6e462d96801e20c7b9f606, user_id=fad43a65b2364e1d8780cf655b769aee, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:52.989579 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7fccb-4b21-4761-9dcd-72504068f44c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:53.007987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1316/2583] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:33:52 2022] PUT /identity/v3/projects/31d35ff71a6e462d96801e20c7b9f606/users/fad43a65b2364e1d8780cf655b769aee/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:53.012566 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7fccb-4b21-4761-9dcd-72504068f44c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:53.015592 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dc331-46e3-456d-861f-ddd8d63854fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:53.016220 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dc331-46e3-456d-861f-ddd8d63854fb service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:53.016497 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dc331-46e3-456d-861f-ddd8d63854fb service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:53.016766 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dc331-46e3-456d-861f-ddd8d63854fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:53.089334 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7fccb-4b21-4761-9dcd-72504068f44c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:53.089567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dc331-46e3-456d-861f-ddd8d63854fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:53.091936 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dc331-46e3-456d-861f-ddd8d63854fb service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:53.101581 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb2328-25fb-455a-96b5-bc4508a98c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:53.102371 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb2328-25fb-455a-96b5-bc4508a98c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:53.102677 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb2328-25fb-455a-96b5-bc4508a98c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:53.102975 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb2328-25fb-455a-96b5-bc4508a98c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:53.103650 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb2328-25fb-455a-96b5-bc4508a98c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:53.105515 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb2328-25fb-455a-96b5-bc4508a98c4c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:53.105638 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1268/2584] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:53.117875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1317/2585] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 27 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:53.121911 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dc331-46e3-456d-861f-ddd8d63854fb service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:53.135491 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dc331-46e3-456d-861f-ddd8d63854fb service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:53.141930 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6dc9b3-7be4-4fb8-be38-85b049a2d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:53.142685 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dc9b3-7be4-4fb8-be38-85b049a2d86a admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:53.143017 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dc9b3-7be4-4fb8-be38-85b049a2d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:53.143622 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dc9b3-7be4-4fb8-be38-85b049a2d86a admin admin] PATH_INFO: `/v3/projects/31d35ff71a6e462d96801e20c7b9f606/users/fad43a65b2364e1d8780cf655b769aee/roles/72129dcc28d546169fd012284e4019ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:53.145462 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dc9b3-7be4-4fb8-be38-85b049a2d86a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d35ff71a6e462d96801e20c7b9f606, user_id=fad43a65b2364e1d8780cf655b769aee, role_id=72129dcc28d546169fd012284e4019ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:53.148513 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dc9b3-7be4-4fb8-be38-85b049a2d86a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:53.165407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1269/2586] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Oct 27 01:33:53 2022] PUT /identity/v3/projects/31d35ff71a6e462d96801e20c7b9f606/users/fad43a65b2364e1d8780cf655b769aee/roles/72129dcc28d546169fd012284e4019ec => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:54.799387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc3b44-908c-4ff7-9fb9-53ce76dbd683 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:54.799868 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc3b44-908c-4ff7-9fb9-53ce76dbd683 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:54.799972 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc3b44-908c-4ff7-9fb9-53ce76dbd683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:54.808281 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:54.838575 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f0bc3b44-908c-4ff7-9fb9-53ce76dbd683 None None] MFA Rules not processed for user `2444386e6ec440de9726d4c9ca701ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:54.843033 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f0bc3b44-908c-4ff7-9fb9-53ce76dbd683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:55.065019 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1318/2587] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:58.454677 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678bbc-5f5e-47bf-9e4f-06445cff6150 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:58.455254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678bbc-5f5e-47bf-9e4f-06445cff6150 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:58.455254 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678bbc-5f5e-47bf-9e4f-06445cff6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:58.488936 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-25678bbc-5f5e-47bf-9e4f-06445cff6150 None None] MFA Rules not processed for user `fad43a65b2364e1d8780cf655b769aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:58.490166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-25678bbc-5f5e-47bf-9e4f-06445cff6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:58.542550 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:58.578593 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1270/2588] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:58.600430 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc3b44-908c-4ff7-9fb9-53ce76dbd683 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:58.602272 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f0bc3b44-908c-4ff7-9fb9-53ce76dbd683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:58.672431 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc3b44-908c-4ff7-9fb9-53ce76dbd683 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:58.676497 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329549d-d00f-47ba-83a4-84ce7dae66fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ea18d542ca24e39ac758f34ad65e7bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:58.677390 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329549d-d00f-47ba-83a4-84ce7dae66fe service glance] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:58.677734 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329549d-d00f-47ba-83a4-84ce7dae66fe service glance] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:58.678072 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329549d-d00f-47ba-83a4-84ce7dae66fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:58.748749 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329549d-d00f-47ba-83a4-84ce7dae66fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:58.751323 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329549d-d00f-47ba-83a4-84ce7dae66fe service glance] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:58.763976 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1319/2589] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:33:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:58.970458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154be93-cd83-457d-a229-890e94b4ad29 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:58.971732 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154be93-cd83-457d-a229-890e94b4ad29 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:58.972078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154be93-cd83-457d-a229-890e94b4ad29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:59.001714 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1154be93-cd83-457d-a229-890e94b4ad29 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:59.003560 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1154be93-cd83-457d-a229-890e94b4ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:59.085893 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1271/2590] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:59.099739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329549d-d00f-47ba-83a4-84ce7dae66fe service glance] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:59.101222 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f329549d-d00f-47ba-83a4-84ce7dae66fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:59.223948 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:59.229809 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329549d-d00f-47ba-83a4-84ce7dae66fe service glance] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:59.235863 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89d1c4-c551-401b-a074-1a1fb3a48946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:59.236635 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89d1c4-c551-401b-a074-1a1fb3a48946 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:59.236766 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89d1c4-c551-401b-a074-1a1fb3a48946 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:59.237400 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89d1c4-c551-401b-a074-1a1fb3a48946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:59.249467 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89d1c4-c551-401b-a074-1a1fb3a48946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:59.254081 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89d1c4-c551-401b-a074-1a1fb3a48946 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:59.268002 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1320/2591] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 01:34:08.128422 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49314560-2aec-46eb-94f9-b53367cd1e7a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:08.128921 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49314560-2aec-46eb-94f9-b53367cd1e7a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:08.129137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49314560-2aec-46eb-94f9-b53367cd1e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:08.149097 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-49314560-2aec-46eb-94f9-b53367cd1e7a None None] MFA Rules not processed for user `16e3d70276ec41868fc9f6a2643ee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:08.150359 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-49314560-2aec-46eb-94f9-b53367cd1e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:08.158438 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1272/2592] 10.222.0.23 () {58 vars in 958 bytes} [Thu Oct 27 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:08.199517 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89d1c4-c551-401b-a074-1a1fb3a48946 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:08.201060 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ff89d1c4-c551-401b-a074-1a1fb3a48946 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:08.214077 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89d1c4-c551-401b-a074-1a1fb3a48946 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:08.217849 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973977-1f3f-4d1f-8cd1-72b4d938f2e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ea18d542ca24e39ac758f34ad65e7bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:08.218553 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973977-1f3f-4d1f-8cd1-72b4d938f2e9 service glance] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:08.218878 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973977-1f3f-4d1f-8cd1-72b4d938f2e9 service glance] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:08.219150 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973977-1f3f-4d1f-8cd1-72b4d938f2e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:08.221089 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b5973977-1f3f-4d1f-8cd1-72b4d938f2e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:08.298965 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5973977-1f3f-4d1f-8cd1-72b4d938f2e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:08.300404 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5973977-1f3f-4d1f-8cd1-72b4d938f2e9 service glance] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:08.311572 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1321/2593] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:08.903289 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49314560-2aec-46eb-94f9-b53367cd1e7a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:08.966570 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49314560-2aec-46eb-94f9-b53367cd1e7a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:08.971177 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fec0b-8d0a-49d2-8885-24f791e7abc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:08.971478 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fec0b-8d0a-49d2-8885-24f791e7abc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:08.971823 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fec0b-8d0a-49d2-8885-24f791e7abc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:08.972165 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fec0b-8d0a-49d2-8885-24f791e7abc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:08.974086 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0a2fec0b-8d0a-49d2-8885-24f791e7abc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:08.990101 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fec0b-8d0a-49d2-8885-24f791e7abc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:08.991574 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fec0b-8d0a-49d2-8885-24f791e7abc5 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:09.004469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1273/2594] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:10.490144 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe05ce7-505f-4349-8a94-64bd43c3d06f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:10.490693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe05ce7-505f-4349-8a94-64bd43c3d06f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:10.490693 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe05ce7-505f-4349-8a94-64bd43c3d06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:10.545064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cfe05ce7-505f-4349-8a94-64bd43c3d06f None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:10.546244 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cfe05ce7-505f-4349-8a94-64bd43c3d06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:10.563472 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1322/2595] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Oct 27 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:10.576790 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fec0b-8d0a-49d2-8885-24f791e7abc5 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:10.599166 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fec0b-8d0a-49d2-8885-24f791e7abc5 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:10.604901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e685b-a06b-4f97-bd77-1f489d1c6493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:10.605509 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e685b-a06b-4f97-bd77-1f489d1c6493 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:10.605791 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e685b-a06b-4f97-bd77-1f489d1c6493 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:10.606058 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e685b-a06b-4f97-bd77-1f489d1c6493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:10.614956 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e685b-a06b-4f97-bd77-1f489d1c6493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:10.616584 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e685b-a06b-4f97-bd77-1f489d1c6493 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:10.625849 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1274/2596] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:34:18.759376 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe05ce7-505f-4349-8a94-64bd43c3d06f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:18.770036 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe05ce7-505f-4349-8a94-64bd43c3d06f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:18.774298 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:18.774955 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:18.775243 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:18.775512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:18.777512 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:18.787753 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:18.789134 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:18.797822 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1323/2597] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:34:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:20.622353 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=74 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:28.793848 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=62 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:29.155460 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e685b-a06b-4f97-bd77-1f489d1c6493 service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:29.165493 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e685b-a06b-4f97-bd77-1f489d1c6493 service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:29.169787 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551b572-aba1-4004-bc04-15b7928a9eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:29.170393 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551b572-aba1-4004-bc04-15b7928a9eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:29.170672 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551b572-aba1-4004-bc04-15b7928a9eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:29.170991 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551b572-aba1-4004-bc04-15b7928a9eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:29.233612 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551b572-aba1-4004-bc04-15b7928a9eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:29.235095 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551b572-aba1-4004-bc04-15b7928a9eb6 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:29.245567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1275/2598] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:34:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:31.103292 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:31.104804 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:31.118152 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b568f-2d82-4d18-9334-33c101aa6276 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:31.122123 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271d7d3-1261-4622-a5bc-87b38c79b54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:31.122773 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271d7d3-1261-4622-a5bc-87b38c79b54c service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:31.123064 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271d7d3-1261-4622-a5bc-87b38c79b54c service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:31.123337 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271d7d3-1261-4622-a5bc-87b38c79b54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:31.132738 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271d7d3-1261-4622-a5bc-87b38c79b54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:31.134174 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271d7d3-1261-4622-a5bc-87b38c79b54c service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:31.143941 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1324/2599] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:34:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:32.782591 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551b572-aba1-4004-bc04-15b7928a9eb6 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:32.797783 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551b572-aba1-4004-bc04-15b7928a9eb6 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:32.804719 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450acf59-8fc2-4269-b7b3-16787c66e2a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:32.805632 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450acf59-8fc2-4269-b7b3-16787c66e2a5 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:32.806115 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450acf59-8fc2-4269-b7b3-16787c66e2a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:32.806448 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450acf59-8fc2-4269-b7b3-16787c66e2a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:32.808329 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-450acf59-8fc2-4269-b7b3-16787c66e2a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:32.821335 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450acf59-8fc2-4269-b7b3-16787c66e2a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:32.822939 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450acf59-8fc2-4269-b7b3-16787c66e2a5 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:32.842385 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1276/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:34:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:41.139705 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:42.836319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=36 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:05.470612 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba17c5-21cd-4446-9961-2709e915f892 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:05.471164 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba17c5-21cd-4446-9961-2709e915f892 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:05.471263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba17c5-21cd-4446-9961-2709e915f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:05.491661 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-31ba17c5-21cd-4446-9961-2709e915f892 None None] MFA Rules not processed for user `22b2d94a0f0c442688ef74359536281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:05.492892 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-31ba17c5-21cd-4446-9961-2709e915f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:05.500564 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1325/2601] 10.222.0.23 () {58 vars in 967 bytes} [Thu Oct 27 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:05.540424 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450acf59-8fc2-4269-b7b3-16787c66e2a5 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:05.552604 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450acf59-8fc2-4269-b7b3-16787c66e2a5 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:05.557901 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638721ef-6b9c-4e66-bb09-1f094c4c6e03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b38639ab90e5439a990cf603c627dab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:05.558506 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638721ef-6b9c-4e66-bb09-1f094c4c6e03 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:05.558797 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638721ef-6b9c-4e66-bb09-1f094c4c6e03 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:05.559056 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638721ef-6b9c-4e66-bb09-1f094c4c6e03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:05.567139 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638721ef-6b9c-4e66-bb09-1f094c4c6e03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:05.568700 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638721ef-6b9c-4e66-bb09-1f094c4c6e03 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:05.576709 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1277/2602] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Oct 27 01:36:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:36:12.417551 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba17c5-21cd-4446-9961-2709e915f892 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:12.483539 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba17c5-21cd-4446-9961-2709e915f892 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:12.488676 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:12.489320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:12.489603 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:12.489876 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] PATH_INFO: `/v3/users/16e3d70276ec41868fc9f6a2643ee6ae` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:12.491040 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e3d70276ec41868fc9f6a2643ee6ae)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:12.492994 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:12.543675 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e3d70276ec41868fc9f6a2643ee6ae'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.552875 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e3d70276ec41868fc9f6a2643ee6ae'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.560215 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e3d70276ec41868fc9f6a2643ee6ae'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.560880 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e3d70276ec41868fc9f6a2643ee6ae'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.573444 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e3d70276ec41868fc9f6a2643ee6ae'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.579741 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1326/2603] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:36:12 2022] DELETE /identity/v3/users/16e3d70276ec41868fc9f6a2643ee6ae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:12.760769 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638721ef-6b9c-4e66-bb09-1f094c4c6e03 service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:12.772476 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638721ef-6b9c-4e66-bb09-1f094c4c6e03 service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:12.838213 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:12.838884 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:12.839168 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:12.839443 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] PATH_INFO: `/v3/projects/5db279ef988247ac8144d8ea3a348295` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:12.840663 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db279ef988247ac8144d8ea3a348295)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:12.842776 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:12.894898 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db279ef988247ac8144d8ea3a348295', 'request_id': 'req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.904078 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db279ef988247ac8144d8ea3a348295', 'request_id': 'req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.910461 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db279ef988247ac8144d8ea3a348295', 'request_id': 'req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.921856 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] The token cache is being invalidate because project 5db279ef988247ac8144d8ea3a348295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:36:12.922137 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.922810 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:12.924305 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1278/2604] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:36:12 2022] DELETE /identity/v3/projects/5db279ef988247ac8144d8ea3a348295 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:12.928387 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:12.929842 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:12.943082 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76905fb-8365-41b3-b3f0-5a4c0f7d4965 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:13.001388 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:13.002035 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:13.002319 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:13.002596 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] PATH_INFO: `/v3/users/fad43a65b2364e1d8780cf655b769aee` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:13.003812 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad43a65b2364e1d8780cf655b769aee)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:13.005737 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:13.019384 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:13.057018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad43a65b2364e1d8780cf655b769aee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.066098 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad43a65b2364e1d8780cf655b769aee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.072917 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad43a65b2364e1d8780cf655b769aee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.073571 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad43a65b2364e1d8780cf655b769aee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.085280 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad43a65b2364e1d8780cf655b769aee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.091308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1327/2605] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:36:12 2022] DELETE /identity/v3/users/fad43a65b2364e1d8780cf655b769aee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:13.271126 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:13.272708 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:13.288641 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5a3e8-3337-4e46-9d4c-a438f4c59c7d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:13.352041 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:13.352725 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:13.352998 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:13.353267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] PATH_INFO: `/v3/projects/31d35ff71a6e462d96801e20c7b9f606` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:13.354404 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d35ff71a6e462d96801e20c7b9f606)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:13.356325 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:13.377852 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:13.405624 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d35ff71a6e462d96801e20c7b9f606', 'request_id': 'req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.413923 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d35ff71a6e462d96801e20c7b9f606', 'request_id': 'req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.420662 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d35ff71a6e462d96801e20c7b9f606', 'request_id': 'req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.432695 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] The token cache is being invalidate because project 31d35ff71a6e462d96801e20c7b9f606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:36:13.432992 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.433798 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:13.435596 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1279/2606] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:36:13 2022] DELETE /identity/v3/projects/31d35ff71a6e462d96801e20c7b9f606 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:23.087702 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:23.429617 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:41.036299 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:41.037778 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:41.095909 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e79a4-bb46-4964-85fe-23a96537cdff admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:41.146470 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:41.147114 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:41.147395 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:41.147652 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:41.149422 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:41.159142 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:41.160672 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:41.174130 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1328/2607] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:36:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:36:41.259954 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:41.261430 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:41.274545 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa0ce8-2c20-4cb4-a3dd-3b5d8d199c94 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:41.278534 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ae71e9e597240ee88c6bd0754244aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:41.279170 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:41.279458 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:41.279701 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:41.281567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:41.356319 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:41.357752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:41.369267 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1280/2608] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:36:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:36:41.430865 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:41.432495 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:41.503503 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181ec1f-b76f-4be7-8963-070eed8a8ecf service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:41.509025 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4511-ea7c-4f18-adfd-62db2ccc1004 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:41.509629 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4511-ea7c-4f18-adfd-62db2ccc1004 service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:41.509905 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4511-ea7c-4f18-adfd-62db2ccc1004 service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:41.510237 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4511-ea7c-4f18-adfd-62db2ccc1004 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:41.511959 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dd7e4511-ea7c-4f18-adfd-62db2ccc1004 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:41.524193 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4511-ea7c-4f18-adfd-62db2ccc1004 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:41.525794 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4511-ea7c-4f18-adfd-62db2ccc1004 service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:41.536017 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1329/2609] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:36:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:36:44.448599 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:44.450302 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:44.466640 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f79e0c-0d42-4936-bea0-c3af4801e868 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:44.472839 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:44.473459 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:44.473738 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:44.474004 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:44.475890 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:44.489241 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:44.490853 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:44.503163 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1281/2610] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:36:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:36:51.532011 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=78 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:54.497585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=40 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:38:03.923165 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4511-ea7c-4f18-adfd-62db2ccc1004 service placement] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:03.936558 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4511-ea7c-4f18-adfd-62db2ccc1004 service placement] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:03.942525 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8fe76-8f63-4117-88a9-618f5f196661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af81f74f98b478ab71c0b22b365e3da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:03.943183 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8fe76-8f63-4117-88a9-618f5f196661 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:03.943543 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8fe76-8f63-4117-88a9-618f5f196661 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:03.943821 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8fe76-8f63-4117-88a9-618f5f196661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:03.945597 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2be8fe76-8f63-4117-88a9-618f5f196661 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:03.958115 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8fe76-8f63-4117-88a9-618f5f196661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:03.959758 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8fe76-8f63-4117-88a9-618f5f196661 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:03.970132 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1330/2611] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:38:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:38:04.244109 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:04.246069 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:04.261633 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b09f6c-23fc-4e4a-83d8-ba900cb92f83 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:04.267576 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cff8f-533c-48d5-b1d2-c3cdd4d52675 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:04.268208 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cff8f-533c-48d5-b1d2-c3cdd4d52675 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:04.268480 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cff8f-533c-48d5-b1d2-c3cdd4d52675 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:04.268752 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cff8f-533c-48d5-b1d2-c3cdd4d52675 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:04.270607 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c34cff8f-533c-48d5-b1d2-c3cdd4d52675 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:04.283246 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cff8f-533c-48d5-b1d2-c3cdd4d52675 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:04.284859 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cff8f-533c-48d5-b1d2-c3cdd4d52675 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:04.295767 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1282/2612] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:38:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:38:09.591402 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8fe76-8f63-4117-88a9-618f5f196661 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:09.602986 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8fe76-8f63-4117-88a9-618f5f196661 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:09.608008 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:09.608624 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:09.608922 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:09.609199 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:09.611015 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:09.632116 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:09.633956 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:09.645308 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1331/2613] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:38:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:38:12.787807 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cff8f-533c-48d5-b1d2-c3cdd4d52675 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:12.798579 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cff8f-533c-48d5-b1d2-c3cdd4d52675 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:12.803833 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec818a18-7b73-4549-8d79-3e2482d3e7ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc32363c074f4418964ea46068a28831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84bb5840092d4782812e0d0bdb4d3cb0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:12.804444 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818a18-7b73-4549-8d79-3e2482d3e7ba service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:12.804764 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818a18-7b73-4549-8d79-3e2482d3e7ba service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:12.805159 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818a18-7b73-4549-8d79-3e2482d3e7ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:12.807002 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ec818a18-7b73-4549-8d79-3e2482d3e7ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:12.818986 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818a18-7b73-4549-8d79-3e2482d3e7ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:12.820602 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818a18-7b73-4549-8d79-3e2482d3e7ba service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:12.831775 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1283/2614] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Oct 27 01:38:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:38:12.856458 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:12.858263 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:12.930484 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a592e7c-241b-4802-a897-7d6ee81fbe3e service placement] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:12.935708 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:12.936379 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:12.936645 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:12.936908 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] PATH_INFO: `/v3/users/2444386e6ec440de9726d4c9ca701ede` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:12.938111 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2444386e6ec440de9726d4c9ca701ede)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:12.940125 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:12.989320 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2444386e6ec440de9726d4c9ca701ede'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:12.997425 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2444386e6ec440de9726d4c9ca701ede'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.004335 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2444386e6ec440de9726d4c9ca701ede'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.004974 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2444386e6ec440de9726d4c9ca701ede'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.016728 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2444386e6ec440de9726d4c9ca701ede'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.022856 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1332/2615] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:38:12 2022] DELETE /identity/v3/users/2444386e6ec440de9726d4c9ca701ede => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:38:13.196567 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec818a18-7b73-4549-8d79-3e2482d3e7ba service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:13.208031 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec818a18-7b73-4549-8d79-3e2482d3e7ba service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:13.273219 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:13.273855 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:13.274179 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:13.274446 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] PATH_INFO: `/v3/projects/b02b0149e52a4a73b78948580cec2b5c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:13.275585 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02b0149e52a4a73b78948580cec2b5c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:13.277482 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:13.326184 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02b0149e52a4a73b78948580cec2b5c', 'request_id': 'req-4ef66da5-cb8b-4f64-8354-a3db4302a430'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.333940 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02b0149e52a4a73b78948580cec2b5c', 'request_id': 'req-4ef66da5-cb8b-4f64-8354-a3db4302a430'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.340322 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02b0149e52a4a73b78948580cec2b5c', 'request_id': 'req-4ef66da5-cb8b-4f64-8354-a3db4302a430'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.351798 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] The token cache is being invalidate because project b02b0149e52a4a73b78948580cec2b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:38:13.352087 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.352745 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.354272 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1284/2616] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:38:13 2022] DELETE /identity/v3/projects/b02b0149e52a4a73b78948580cec2b5c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:38:13.358418 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:13.360001 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:13.374047 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344c48b-3e36-46e4-9cdd-2b2016462e26 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:13.426902 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:38:13.437663 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:13.438336 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:13.438985 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:13.439771 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] PATH_INFO: `/v3/users/5246844d767c445c8fea532787d52d37` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:13.440987 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5246844d767c445c8fea532787d52d37)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:13.442931 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:13.495756 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5246844d767c445c8fea532787d52d37'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.503867 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5246844d767c445c8fea532787d52d37'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.510739 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5246844d767c445c8fea532787d52d37'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.511381 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5246844d767c445c8fea532787d52d37'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.523018 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2e986051-c7c8-4ebf-a814-104f5acc1883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5246844d767c445c8fea532787d52d37'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.529275 dv-cinder-815582-19-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1333/2617] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 27 01:38:13 2022] DELETE /identity/v3/users/5246844d767c445c8fea532787d52d37 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:38:13.700755 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:13.702203 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:13.716793 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef66da5-cb8b-4f64-8354-a3db4302a430 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:13.781731 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b819844d641b4956ae9399e9c171524d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab267813de0e4d19a617dbecdaeb9ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:13.782367 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:13.782643 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:13.782936 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] PATH_INFO: `/v3/projects/1f5e58819f7a48abafa07771792332e6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:13.784151 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5e58819f7a48abafa07771792332e6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:13.786050 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:13.793062 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:38:13.836577 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5e58819f7a48abafa07771792332e6', 'request_id': 'req-54d56a51-e94d-4b0e-b16c-e8718443645d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.845073 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5e58819f7a48abafa07771792332e6', 'request_id': 'req-54d56a51-e94d-4b0e-b16c-e8718443645d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.851469 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5e58819f7a48abafa07771792332e6', 'request_id': 'req-54d56a51-e94d-4b0e-b16c-e8718443645d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.863795 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] The token cache is being invalidate because project 1f5e58819f7a48abafa07771792332e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:38:13.864081 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.864803 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-54d56a51-e94d-4b0e-b16c-e8718443645d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:38:13.866407 dv-cinder-815582-19-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1285/2618] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 27 01:38:13 2022] DELETE /identity/v3/projects/1f5e58819f7a48abafa07771792332e6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:38:23.525844 dv-cinder-815582-19-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:38:23.860150 dv-cinder-815582-19-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}